Jul 27 19:23:33.292480 ip-10-0-131-166 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 19:23:33.292494 ip-10-0-131-166 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 19:23:33.292504 ip-10-0-131-166 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 19:23:33.292813 ip-10-0-131-166 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 19:23:44.480036 ip-10-0-131-166 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 19:23:44.480055 ip-10-0-131-166 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 37e433430dd745b6804a4d73082d4095 --
Jul 27 19:25:40.172177 ip-10-0-131-166 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:25:40.628388 ip-10-0-131-166 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:25:40.628388 ip-10-0-131-166 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:25:40.628388 ip-10-0-131-166 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:25:40.628388 ip-10-0-131-166 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:25:40.628388 ip-10-0-131-166 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:25:40.629510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.629390    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:25:40.636170 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636154    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:25:40.636170 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636170    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636174    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636177    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636181    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636184    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636188    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636190    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636193    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636196    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636200    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636202    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636206    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636208    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636211    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636214    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636217    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636220    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636228    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636231    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636234    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:25:40.636244 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636237    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636240    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636243    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636245    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636248    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636251    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636254    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636257    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636260    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636263    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636267    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636271    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636274    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636277    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636280    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636283    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636285    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636289    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636292    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636295    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:25:40.636727 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636297    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636301    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636304    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636307    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636310    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636312    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636315    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636317    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636321    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636324    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636326    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636329    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636332    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636334    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636337    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636340    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636343    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636345    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636348    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636351    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:25:40.637517 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636353    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636356    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636359    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636363    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636366    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636369    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636372    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636375    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636377    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636380    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636384    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636387    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636391    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636393    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636396    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636399    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636401    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636404    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636407    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:25:40.638341 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636410    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636413    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636415    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636418    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636420    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636423    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636425    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636428    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636431    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636435    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636438    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636441    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636444    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636447    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636450    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636452    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636455    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636458    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.636461    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:25:40.638839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638210    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638226    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638232    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638236    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638241    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638247    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638253    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638263    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638268    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638273    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638277    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638281    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638286    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638290    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638295    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638299    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638304    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638308    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638312    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:25:40.639349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638317    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638330    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638336    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638340    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638345    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638349    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638354    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638358    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638363    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638370    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638414    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638441    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638446    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638452    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638473    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638584    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638595    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638599    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638604    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638608    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:25:40.639842 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638612    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638616    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638621    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638625    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638633    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638637    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638642    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638647    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638651    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638655    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638659    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638663    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638667    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638672    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638676    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638680    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638684    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638688    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638692    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638696    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:25:40.640366 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638699    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638703    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638708    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638713    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638717    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638722    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638726    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638733    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638739    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638744    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638748    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638753    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638759    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638763    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638767    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638771    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638778    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638782    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638785    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638788    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:25:40.640916 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638791    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638793    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638796    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638799    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638801    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638804    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638807    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638810    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638813    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638816    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638818    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638821    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638824    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638827    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638829    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638833    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638836    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638839    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638843    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.638848    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:25:40.641430 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639273    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639280    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639283    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639286    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639290    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639293    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639295    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639298    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639301    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639304    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639306    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639309    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639312    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639314    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639317    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639319    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639322    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639325    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639327    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639331    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:25:40.641942 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639333    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639336    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639338    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639341    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639344    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639350    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639352    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639356    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639359    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639362    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639366    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639369    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639373    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639375    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639378    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639381    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639384    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639387    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639389    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639393    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:25:40.642446 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639396    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639399    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639401    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639404    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639407    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639409    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639412    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639414    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639417    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639420    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639422    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639425    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639428    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639430    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639433    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639436    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639438    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639442    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639445    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639448    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:25:40.642979 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639451    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639454    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639456    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639459    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639461    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639464    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639469    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639473    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639476    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639479    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639482    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639485    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639488    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639491    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639493    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639496    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639498    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639502    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639506    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:25:40.643487 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639509    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639512    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639515    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639519    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639522    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639525    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639527    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639530    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639533    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639536    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639540    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639543    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639546    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639548    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639551    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639554    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639557    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639559    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639562    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.639565    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:25:40.643976 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639641    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639651    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639661    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639668    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639674    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639679    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639684    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639689    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639692    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639696    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639700    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639703    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639706    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639709    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639712    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639715    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639720    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639723    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639729    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639732    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639735    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639738    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639743    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639747    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:25:40.644473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639750    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639754    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639757    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639760    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639764    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639767    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639770    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639773    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639777    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639780    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639784    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639787    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639790    2559 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639793    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639797    2559 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639800    2559 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639803    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639806    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639809    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639813    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639817    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639819    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639822    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639826    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639829    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:25:40.645065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639833    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639836    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639839    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639842    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639845    2559 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639850    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639853    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639858    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639863    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639868    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639872    2559 flags.go:64] FLAG: --help="false"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639876    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-166.ec2.internal"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639879    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639882    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639885    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639901    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639905    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639908    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639911    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639914    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639917    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639920    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639923    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639926    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:25:40.645720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639929    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639932    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639935    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639938    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639941    2559 flags.go:64] FLAG: --lock-file=""
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639944    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639947    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639950    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639956    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639960    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639964    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639967    2559 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639970    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639975    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639978    2559 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639981    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639986    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639989    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639993    2559 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639996    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.639999    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640002    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640005    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640007    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640010    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:25:40.646340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640013    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640021    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640024    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640027    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640030    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640033    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640039    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640041    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640044    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640047    2559 flags.go:64] FLAG: --port="10250"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640051    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640053    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bcf1b1f930346c82"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640057    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640060    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640063    2559 flags.go:64] FLAG: --register-node="true"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640066    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640074    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640080    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640083    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640086    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640089    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640093    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640096    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640099    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640102    2559 flags.go:64] FLAG: --runonce="false"
Jul 27 19:25:40.647050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640105    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640109    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640112    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640115    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640118    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640121    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640125    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640128    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640131    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640134    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640137    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640140    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640143    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640145    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640148    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640153    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640157    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640159    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640164    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640167    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640170    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640173    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640176    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640179    2559 flags.go:64] FLAG: --v="2"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640184    2559 flags.go:64] FLAG: --version="false"
Jul 27 19:25:40.648185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640189    2559 flags.go:64] FLAG: --vmodule=""
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640193    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.640197    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640317    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640320    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640323    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640326    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640329    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640332    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640335    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640338    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640341    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640344    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640346    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640349    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640352    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640354    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640357    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640360    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640363    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:25:40.649277 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640365    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640368    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640371    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640374    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640376    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640379    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640382    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640384    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640387    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640389    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640393    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640399    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640403    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640406    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640409    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640411    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640414    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640417    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640419    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:25:40.649937 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640422    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640426    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640429    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640432    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640435    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640438    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640441    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640444    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640447    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640450    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640453    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640456    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640459    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640462    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640465    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640468    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640471    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640473    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640476    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640478    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:25:40.650655 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640482    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640485    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640488    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640490    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640494    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640497    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640500    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640504    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640506    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640509    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640512    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640514    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640517    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640519    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640522    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640526    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640529    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640533    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640535    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:25:40.651749 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640538    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640541    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640544    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640547    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640549    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640552    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640555    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640557    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640560    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640563    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640566    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640568    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640571    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640576    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640578    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640581    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640584    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640590    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640592    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640595    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:25:40.652270 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640598    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640601    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640603    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.640606    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.641306    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.649257    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.649279    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.650152    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.650171    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650266    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650274    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650280    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650285    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650290    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650295    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:25:40.653052 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650300    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650305    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650309    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650314    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650319    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650323    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650328    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650332    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650337    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650342    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650346    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650354    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650361    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650366    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650370    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650375    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650380    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650384    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650388    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:25:40.653711 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650393    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650398    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650403    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650407    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650415    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650420    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650424    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650428    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650433    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650437    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650442    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650446    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650451    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650456    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650460    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650464    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650469    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650473    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650478    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:25:40.654314 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650482    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650486    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650491    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650495    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650500    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650504    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650508    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650513    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650517    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650523    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650530    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650535    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650539    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650543    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650548    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650552    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650557    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650564    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650572    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:25:40.655001 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650576    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650582    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650587    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650591    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650596    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650600    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650605    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650609    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650613    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650618    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650622    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650627    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650631    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650635    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650640    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650644    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650649    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650653    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650657    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650661    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:25:40.655507 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650665    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650669    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650674    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650678    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650683    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650687    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650693    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650698    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650703    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650707    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650712    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650717    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650722    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650727    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650731    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:25:40.656063 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650735    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.650744    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650944    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650953    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650957    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650962    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650965    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650970    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650974    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650978    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650981    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650985    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650990    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650994    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.650998    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:25:40.656463 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651002    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651006    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651010    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651014    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651018    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651022    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651026    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651030    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651034    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651039    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651043    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651047    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651052    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651057    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651061    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651066    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651071    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651077    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651081    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:25:40.656839 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651086    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651091    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651098    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651103    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651108    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651112    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651117    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651122    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651126    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651131    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651136    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651141    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651145    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651149    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651154    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651158    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651162    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651167    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651171    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:25:40.657349 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651175    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651180    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651184    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651188    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651192    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651197    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651201    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651206    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651211    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651216    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651221    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651225    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651229    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651233    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651238    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651242    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651246    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651250    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651254    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651259    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:25:40.657824 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651263    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651267    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651271    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651275    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651280    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651284    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651288    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651293    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651297    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651304    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651310    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651315    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651319    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651324    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651328    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651332    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651336    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651341    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651346    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651351    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:25:40.658350 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651355    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651359    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651363    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651368    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651372    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651376    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651381    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:40.651385    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.651394    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.651568    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.654734    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.656302    2559 server.go:1019] "Starting client certificate rotation"
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.656410    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:25:40.658853 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.657093    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:25:40.660350 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.660326    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:25:40.664100 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.664085    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:25:40.679002 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.678979    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:25:40.681444 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.681427    2559 log.go:25] "Validated CRI v1 image API"
Jul 27 19:25:40.682213 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.682198    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:25:40.685593 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.685572    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a1c36fc1-6c86-47d5-aa34-e6a4c016b4ec:/dev/nvme0n1p3 fbc88c74-59e5-40a4-9f3a-df2d47de692c:/dev/nvme0n1p4]
Jul 27 19:25:40.685664 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.685592    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:25:40.693803 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.693676    2559 manager.go:216] Machine: {Timestamp:2026-07-27 19:25:40.692262641 +0000 UTC m=+0.387818727 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099941 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec260425a927459fc21b2991c45fac41 SystemUUID:ec260425-a927-459f-c21b-2991c45fac41 BootID:37e43343-0dd7-45b6-804a-4d73082d4095 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:f7:39:a1:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:f7:39:a1:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:9b:92:2a:39:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:25:40.693803 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.693789    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:25:40.693986 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.693904    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:25:40.697106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.697073    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:25:40.697318 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.697112    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:25:40.697943 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.697931    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:25:40.697988 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.697946    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:25:40.697988 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.697956    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:25:40.698717 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.698707    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:25:40.699665 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.699654    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:25:40.700580 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.700563    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:25:40.701793 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.701781    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:25:40.701975 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.701965    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:25:40.702010 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.701995    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:25:40.702010 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.702005    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:25:40.702072 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.702025    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:25:40.702072 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.702036    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:25:40.702072 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.702046    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:25:40.702435 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.702423    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:25:40.702481 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.702445    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:25:40.706877 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.706847    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:25:40.709100 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.709087    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:25:40.709149 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.709117    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:25:40.711036 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711024    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:25:40.711079 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711045    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:25:40.711079 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711052    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:25:40.711079 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711058    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:25:40.711079 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711070    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:25:40.711079 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711079    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:25:40.711224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711088    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:25:40.711224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711093    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:25:40.711224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711100    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:25:40.711224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711105    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:25:40.711224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711114    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:25:40.711224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.711122    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:25:40.712142 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.712132    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:25:40.712142 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.712141    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:25:40.715423 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.715409    2559 server.go:1268] "Started kubelet"
Jul 27 19:25:40.715543 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.715490    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:25:40.715611 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.715569    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:25:40.715611 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.715488    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:25:40.716350 ip-10-0-131-166 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:25:40.716779 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.716753    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:25:40.716983 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.716916    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:25:40.717040 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.716997    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:25:40.717040 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.716993    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:25:40.717714 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.717677    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:25:40.721554 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.721524    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:25:40.723452 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.722293    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-166.ec2.internal.18c63c0fc459e470  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-166.ec2.internal,UID:ip-10-0-131-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-166.ec2.internal,},FirstTimestamp:2026-07-27 19:25:40.715381872 +0000 UTC m=+0.410937958,LastTimestamp:2026-07-27 19:25:40.715381872 +0000 UTC m=+0.410937958,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-166.ec2.internal,}"
Jul 27 19:25:40.726283 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.726264    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:25:40.726392 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.726281    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:25:40.726476 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.726441    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:40.727152 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727129    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:25:40.727252 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727133    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:25:40.727252 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727178    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:25:40.727356 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727306    2559 factory.go:55] Registering systemd factory
Jul 27 19:25:40.727356 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727322    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:25:40.727356 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727327    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:25:40.727356 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727337    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:25:40.727546 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727527    2559 factory.go:153] Registering CRI-O factory
Jul 27 19:25:40.727546 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727546    2559 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:25:40.727677 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727633    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:25:40.727677 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727656    2559 factory.go:103] Registering Raw factory
Jul 27 19:25:40.727677 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.727672    2559 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:25:40.728804 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.728450    2559 manager.go:349] Starting recovery of all containers
Jul 27 19:25:40.737438 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.737405    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:25:40.737570 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.737429    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:25:40.742003 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.741985    2559 manager.go:354] Recovery completed
Jul 27 19:25:40.746569 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.746555    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:40.748422 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.748399    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:40.748478 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.748439    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:40.748478 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.748452    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:40.748992 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.748979    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:25:40.748992 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.748988    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:40.749087 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.748992    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:25:40.749087 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.749032    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:25:40.750594 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.750577    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:40.750674 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.750628    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:40.750674 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.750640    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:40.750909 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.750819    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-166.ec2.internal.18c63c0fc6520f5b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-166.ec2.internal,UID:ip-10-0-131-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-166.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-166.ec2.internal,},FirstTimestamp:2026-07-27 19:25:40.748423003 +0000 UTC m=+0.443979090,LastTimestamp:2026-07-27 19:25:40.748423003 +0000 UTC m=+0.443979090,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-166.ec2.internal,}"
Jul 27 19:25:40.751021 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.751004    2559 policy_none.go:49] "None policy: Start"
Jul 27 19:25:40.751065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.751041    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:25:40.751065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.751059    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:25:40.752401 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.752389    2559 policy_none.go:47] "Start"
Jul 27 19:25:40.763697 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.763549    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xg72z"
Jul 27 19:25:40.770469 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.770447    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xg72z"
Jul 27 19:25:40.772237 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.772152    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-166.ec2.internal.18c63c0fc652694d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-166.ec2.internal,UID:ip-10-0-131-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-166.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-166.ec2.internal,},FirstTimestamp:2026-07-27 19:25:40.748446029 +0000 UTC m=+0.444002118,LastTimestamp:2026-07-27 19:25:40.748446029 +0000 UTC m=+0.444002118,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-166.ec2.internal,}"
Jul 27 19:25:40.792306 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.792289    2559 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:25:40.792383 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.792340    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:25:40.792383 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.792354    2559 server.go:87] "Starting device plugin registration server"
Jul 27 19:25:40.792640 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.792627    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:25:40.792680 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.792645    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:25:40.792738 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.792720    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:25:40.793262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.792878    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:25:40.793262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.792893    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:25:40.793409 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.793389    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:25:40.793461 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.793449    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:40.893163 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.893134    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:40.895836 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.894576    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:40.895836 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.894604    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:40.895836 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.894616    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:40.895836 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.894676    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-166.ec2.internal"
Jul 27 19:25:40.905217 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.905193    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-166.ec2.internal"
Jul 27 19:25:40.905339 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.905221    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-166.ec2.internal\": node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:40.931013 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.930985    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:40.933814 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.933789    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:25:40.935108 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.935087    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:25:40.935185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.935129    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:25:40.935185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.935157    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:25:40.935266 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:40.935211    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:25:40.937645 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:40.937624    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:41.032098 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.032007    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.036318 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.036297    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"]
Jul 27 19:25:41.036391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.036373    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:41.038158 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.038136    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:41.038288 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.038168    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:41.038288 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.038182    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:41.040085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.040069    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:41.040201 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.040186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.040253 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.040243    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:41.040928 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.040909    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:41.040984 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.040945    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:41.040984 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.040961    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:41.041075 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.040960    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:41.041075 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.041047    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:41.041075 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.041065    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:41.042485 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.042466    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.042566 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.042507    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:41.047661 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.047648    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:41.047756 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.047674    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:41.047756 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.047685    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:41.056477 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.056458    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-166.ec2.internal\" not found" node="ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.062443 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.062428    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-166.ec2.internal\" not found" node="ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.129894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.129848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67ce743d4b65ed408ad4f63a5d56e92b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"67ce743d4b65ed408ad4f63a5d56e92b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.129894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.129896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67ce743d4b65ed408ad4f63a5d56e92b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"67ce743d4b65ed408ad4f63a5d56e92b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.130044 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.129916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef1a0ca089fb19d21b89d75ed9181952-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.ec2.internal\" (UID: \"ef1a0ca089fb19d21b89d75ed9181952\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.133080 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.133062    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.230965 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.230933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67ce743d4b65ed408ad4f63a5d56e92b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"67ce743d4b65ed408ad4f63a5d56e92b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.231029 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.230969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef1a0ca089fb19d21b89d75ed9181952-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.ec2.internal\" (UID: \"ef1a0ca089fb19d21b89d75ed9181952\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.231029 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.230986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67ce743d4b65ed408ad4f63a5d56e92b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"67ce743d4b65ed408ad4f63a5d56e92b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.231094 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.231067    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/67ce743d4b65ed408ad4f63a5d56e92b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"67ce743d4b65ed408ad4f63a5d56e92b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.231127 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.231073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67ce743d4b65ed408ad4f63a5d56e92b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal\" (UID: \"67ce743d4b65ed408ad4f63a5d56e92b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.231127 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.231073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ef1a0ca089fb19d21b89d75ed9181952-config\") pod \"kube-apiserver-proxy-ip-10-0-131-166.ec2.internal\" (UID: \"ef1a0ca089fb19d21b89d75ed9181952\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.234173 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.234158    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.335311 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.335223    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.359306 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.359278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.366904 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.366873    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.435950 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.435909    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.537025 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.537001    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.637580 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.637514    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.655695 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.655663    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:25:41.655879 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.655842    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:25:41.737800 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.737769    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.776976 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.776930    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:20:40 +0000 UTC" deadline="2028-02-18 18:03:28.164177532 +0000 UTC"
Jul 27 19:25:41.776976 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.776966    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13702h37m46.387215106s"
Jul 27 19:25:41.800276 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.800255    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:25:41.801463 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.801440    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:25:41.801582 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.801476    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:25:41.801582 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.801487    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:25:41.838385 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:41.838353    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-166.ec2.internal\" not found"
Jul 27 19:25:41.864988 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.864966    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:41.927873 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.927825    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.940971 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.940950    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:25:41.942903 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.942884    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal"
Jul 27 19:25:41.949772 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.949753    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:25:41.952753 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:41.952728    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ce743d4b65ed408ad4f63a5d56e92b.slice/crio-ab85cdce940d8ad7e7f194034d786f9fd3351136474f04e866447be672f99f39 WatchSource:0}: Error finding container ab85cdce940d8ad7e7f194034d786f9fd3351136474f04e866447be672f99f39: Status 404 returned error can't find the container with id ab85cdce940d8ad7e7f194034d786f9fd3351136474f04e866447be672f99f39
Jul 27 19:25:41.953009 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:41.952991    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1a0ca089fb19d21b89d75ed9181952.slice/crio-6893be854552a54150558060910af5559b6e81d9c2b3351763a41e1ced467a54 WatchSource:0}: Error finding container 6893be854552a54150558060910af5559b6e81d9c2b3351763a41e1ced467a54: Status 404 returned error can't find the container with id 6893be854552a54150558060910af5559b6e81d9c2b3351763a41e1ced467a54
Jul 27 19:25:41.957084 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:41.957068    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:25:42.077148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.077122    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:42.280082 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.279997    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:42.494005 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.493965    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:25:42.703460 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.703428    2559 apiserver.go:52] "Watching apiserver"
Jul 27 19:25:42.709437 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.709408    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:25:42.711494 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.711465    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal","openshift-multus/multus-9q9hc","openshift-multus/multus-additional-cni-plugins-ghclq","openshift-multus/network-metrics-daemon-gw4wp","openshift-network-diagnostics/network-check-target-fr7pm","kube-system/konnectivity-agent-r9vrm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4","openshift-dns/node-resolver-dnd5h","openshift-image-registry/node-ca-vfx74","openshift-network-operator/iptables-alerter-lg6kn","openshift-ovn-kubernetes/ovnkube-node-qjf8q","kube-system/global-pull-secret-syncer-x2hh9","kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jqkf4"]
Jul 27 19:25:42.713169 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.713149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:42.713269 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.713236    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:42.714673 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.714651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:42.714759 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.714712    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:42.716180 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.716157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.717452 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.717431    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.718989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.718277    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qtkg7\""
Jul 27 19:25:42.718989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.718581    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:25:42.718989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.718820    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:25:42.718989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.718826    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:25:42.718989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.718966    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.719747 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.719412    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:25:42.719747 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.719588    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:25:42.719747 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.719638    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5jnpg\""
Jul 27 19:25:42.719747 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.719681    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:25:42.719747 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.719734    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:25:42.720048 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.719919    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:25:42.720567 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.720208    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:42.722025 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.722005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.722112 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.722063    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:25:42.725364 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.722715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-956lq\""
Jul 27 19:25:42.725364 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.723415    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:25:42.725364 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.723590    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-424sf\""
Jul 27 19:25:42.725364 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.723591    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:25:42.725364 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.725251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.726160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.725916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.726777 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.726752    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:25:42.728188 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728085    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:25:42.728272 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728223    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x95fj\""
Jul 27 19:25:42.728326 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728286    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:25:42.728452 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728430    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:25:42.728589 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728481    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.728652 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728603    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:25:42.728652 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rd8fr\""
Jul 27 19:25:42.728758 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728580    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xgw9f\""
Jul 27 19:25:42.728925 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728605    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:42.728925 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728544    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:42.728925 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.728546    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:25:42.729255 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.729239    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:25:42.729429 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.729413    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.729508 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.729481    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:42.730662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.730642    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:25:42.731016 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.730994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.731216 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.731201    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:25:42.731340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.731242    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:25:42.731514 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.731497    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r29b5\""
Jul 27 19:25:42.731580 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.731550    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:25:42.731633 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.731589    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:25:42.731700 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.731684    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:25:42.733039 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.733014    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:25:42.733592 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.733572    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lqbgk\""
Jul 27 19:25:42.733986 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.733968    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:25:42.740221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/139e1d59-13a4-4234-8dba-986ab727ef52-konnectivity-ca\") pod \"konnectivity-agent-r9vrm\" (UID: \"139e1d59-13a4-4234-8dba-986ab727ef52\") " pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:42.740323 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-env-overrides\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.740323 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpcv\" (UniqueName: \"kubernetes.io/projected/445d35f0-1473-4e0d-b15a-f867170652e1-kube-api-access-wnpcv\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.740323 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/935c5a73-81d4-4319-90f2-038e4f695dd9-serviceca\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.740323 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-socket-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.740524 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:42.740633 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740455    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.740842 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740650    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-system-cni-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.740936 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.740994 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-slash\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-socket-dir-parent\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1423591-5924-49ef-aa8f-397afa5ff9ac-tmp-dir\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.741147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjvlw\" (UniqueName: \"kubernetes.io/projected/b1423591-5924-49ef-aa8f-397afa5ff9ac-kube-api-access-kjvlw\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.741147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovnkube-config\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovn-node-metrics-cert\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/139e1d59-13a4-4234-8dba-986ab727ef52-agent-certs\") pod \"konnectivity-agent-r9vrm\" (UID: \"139e1d59-13a4-4234-8dba-986ab727ef52\") " pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-etc-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.740808    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1423591-5924-49ef-aa8f-397afa5ff9ac-hosts-file\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-run-ovn-kubernetes\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-cni-bin\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-kubelet\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-cni-bin\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-cni-netd\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-os-release\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbssf\" (UniqueName: \"kubernetes.io/projected/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-kube-api-access-sbssf\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jsrc\" (UniqueName: \"kubernetes.io/projected/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-kube-api-access-8jsrc\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-cni-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741571    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-cni-multus\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-conf-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-run-netns\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-os-release\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4xv\" (UniqueName: \"kubernetes.io/projected/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-kube-api-access-zm4xv\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/935c5a73-81d4-4319-90f2-038e4f695dd9-host\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.741745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovnkube-script-lib\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-cni-binary-copy\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-etc-kubernetes\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8th9r\" (UniqueName: \"kubernetes.io/projected/935c5a73-81d4-4319-90f2-038e4f695dd9-kube-api-access-8th9r\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-registration-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s25sf\" (UniqueName: \"kubernetes.io/projected/ab06e64b-b71c-47e2-b5e9-85941805ae44-kube-api-access-s25sf\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-system-cni-dir\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-daemon-config\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.741986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302ba1e5-c018-480e-b208-25d58c4d1993-iptables-alerter-script\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-systemd-units\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-log-socket\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-hostroot\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t49p4\" (UniqueName: \"kubernetes.io/projected/302ba1e5-c018-480e-b208-25d58c4d1993-kube-api-access-t49p4\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-systemd\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-netns\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302ba1e5-c018-480e-b208-25d58c4d1993-host-slash\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.742405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-multus-certs\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-kubelet\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-cnibin\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-k8s-cni-cncf-io\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-sys-fs\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-var-lib-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-ovn\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-node-log\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-cnibin\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.743160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.742757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-device-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.779193 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.779168    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fncxm"
Jul 27 19:25:42.787516 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.787229    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fncxm"
Jul 27 19:25:42.828074 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.828045    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-device-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/139e1d59-13a4-4234-8dba-986ab727ef52-konnectivity-ca\") pod \"konnectivity-agent-r9vrm\" (UID: \"139e1d59-13a4-4234-8dba-986ab727ef52\") " pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-env-overrides\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpcv\" (UniqueName: \"kubernetes.io/projected/445d35f0-1473-4e0d-b15a-f867170652e1-kube-api-access-wnpcv\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/935c5a73-81d4-4319-90f2-038e4f695dd9-serviceca\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-socket-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843564    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-lib-modules\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-system-cni-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/855ba6bc-d302-4d1d-b728-e39baf9c6393-dbus\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.843694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843706    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8698268-9532-4b4f-837c-0a2ae30f6dd8-tmp\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsvx6\" (UniqueName: \"kubernetes.io/projected/c8698268-9532-4b4f-837c-0a2ae30f6dd8-kube-api-access-hsvx6\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-slash\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-socket-dir-parent\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1423591-5924-49ef-aa8f-397afa5ff9ac-tmp-dir\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjvlw\" (UniqueName: \"kubernetes.io/projected/b1423591-5924-49ef-aa8f-397afa5ff9ac-kube-api-access-kjvlw\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843936    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/855ba6bc-d302-4d1d-b728-e39baf9c6393-kubelet-config\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-sys\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.843984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovnkube-config\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844010    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovn-node-metrics-cert\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/139e1d59-13a4-4234-8dba-986ab727ef52-agent-certs\") pod \"konnectivity-agent-r9vrm\" (UID: \"139e1d59-13a4-4234-8dba-986ab727ef52\") " pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-etc-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1423591-5924-49ef-aa8f-397afa5ff9ac-hosts-file\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-run-ovn-kubernetes\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.844510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-cni-bin\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-kubelet\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysconfig\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-cni-bin\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-cni-netd\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-os-release\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbssf\" (UniqueName: \"kubernetes.io/projected/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-kube-api-access-sbssf\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-kubernetes\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jsrc\" (UniqueName: \"kubernetes.io/projected/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-kube-api-access-8jsrc\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-cni-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-cni-multus\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-conf-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-host\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-run-netns\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-os-release\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4xv\" (UniqueName: \"kubernetes.io/projected/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-kube-api-access-zm4xv\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.845277 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/935c5a73-81d4-4319-90f2-038e4f695dd9-host\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysctl-d\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovnkube-script-lib\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844695    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-cni-binary-copy\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-etc-kubernetes\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8th9r\" (UniqueName: \"kubernetes.io/projected/935c5a73-81d4-4319-90f2-038e4f695dd9-kube-api-access-8th9r\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-registration-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-modprobe-d\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-var-lib-kubelet\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s25sf\" (UniqueName: \"kubernetes.io/projected/ab06e64b-b71c-47e2-b5e9-85941805ae44-kube-api-access-s25sf\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-system-cni-dir\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-daemon-config\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302ba1e5-c018-480e-b208-25d58c4d1993-iptables-alerter-script\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-run\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.844993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-systemd-units\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-log-socket\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-hostroot\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.846067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t49p4\" (UniqueName: \"kubernetes.io/projected/302ba1e5-c018-480e-b208-25d58c4d1993-kube-api-access-t49p4\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysctl-conf\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845126    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-systemd\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-tuned\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-systemd\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-netns\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302ba1e5-c018-480e-b208-25d58c4d1993-host-slash\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-multus-certs\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-kubelet\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-cnibin\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-k8s-cni-cncf-io\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-sys-fs\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-var-lib-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845482    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-ovn\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-node-log\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.846698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.847473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-cnibin\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.847473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-cnibin\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.847473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.845733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-device-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.847473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.846313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/139e1d59-13a4-4234-8dba-986ab727ef52-konnectivity-ca\") pod \"konnectivity-agent-r9vrm\" (UID: \"139e1d59-13a4-4234-8dba-986ab727ef52\") " pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:42.847473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.846731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-env-overrides\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.847473 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.847374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/935c5a73-81d4-4319-90f2-038e4f695dd9-serviceca\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.847790 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.847481    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-socket-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.847979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.847949    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-os-release\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.848065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.847995    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-hostroot\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.848065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-system-cni-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.848144 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.848181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848168    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-slash\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.848239 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-socket-dir-parent\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.848316 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/935c5a73-81d4-4319-90f2-038e4f695dd9-host\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.848355 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-system-cni-dir\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.848483 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1423591-5924-49ef-aa8f-397afa5ff9ac-tmp-dir\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848640    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-systemd\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-daemon-config\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848905    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302ba1e5-c018-480e-b208-25d58c4d1993-host-slash\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-netns\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848981    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-registration-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.848999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovnkube-config\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849021    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-sys-fs\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-multus-certs\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-kubelet\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-systemd-units\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-cni-binary-copy\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovnkube-script-lib\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-run-ovn\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-var-lib-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849241    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-etc-kubernetes\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.849366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302ba1e5-c018-480e-b208-25d58c4d1993-iptables-alerter-script\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849282    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-run-k8s-cni-cncf-io\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849296    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-etc-openvswitch\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-log-socket\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849316    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-cnibin\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849346    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-cni-multus\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-run-ovn-kubernetes\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-conf-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-cni-bin\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.849374    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-cni-netd\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.849467    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:43.349422825 +0000 UTC m=+3.044978925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-os-release\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849498    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-multus-cni-dir\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-cni-bin\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.850791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849603    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1423591-5924-49ef-aa8f-397afa5ff9ac-hosts-file\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.851662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-host-run-netns\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.851662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849689    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab06e64b-b71c-47e2-b5e9-85941805ae44-node-log\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.851662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849762    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/445d35f0-1473-4e0d-b15a-f867170652e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.851662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.849814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-host-var-lib-kubelet\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.851662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.850045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.851662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.850731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/445d35f0-1473-4e0d-b15a-f867170652e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.852910 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.852845    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab06e64b-b71c-47e2-b5e9-85941805ae44-ovn-node-metrics-cert\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.852910 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.852898    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:25:42.853065 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.852917    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:25:42.853065 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.852930    2559 projected.go:196] Error preparing data for projected volume kube-api-access-m7llt for pod openshift-network-diagnostics/network-check-target-fr7pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:42.853065 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.852995    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt podName:8e5dc63c-1fe2-42fb-8ce7-373b13831df8 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:43.352978485 +0000 UTC m=+3.048534573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m7llt" (UniqueName: "kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt") pod "network-check-target-fr7pm" (UID: "8e5dc63c-1fe2-42fb-8ce7-373b13831df8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:42.854080 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.853952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/139e1d59-13a4-4234-8dba-986ab727ef52-agent-certs\") pod \"konnectivity-agent-r9vrm\" (UID: \"139e1d59-13a4-4234-8dba-986ab727ef52\") " pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:42.855598 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.855570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpcv\" (UniqueName: \"kubernetes.io/projected/445d35f0-1473-4e0d-b15a-f867170652e1-kube-api-access-wnpcv\") pod \"multus-additional-cni-plugins-ghclq\" (UID: \"445d35f0-1473-4e0d-b15a-f867170652e1\") " pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:42.857597 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.857575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s25sf\" (UniqueName: \"kubernetes.io/projected/ab06e64b-b71c-47e2-b5e9-85941805ae44-kube-api-access-s25sf\") pod \"ovnkube-node-qjf8q\" (UID: \"ab06e64b-b71c-47e2-b5e9-85941805ae44\") " pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:42.864142 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.864117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jsrc\" (UniqueName: \"kubernetes.io/projected/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-kube-api-access-8jsrc\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:42.864245 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.864201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjvlw\" (UniqueName: \"kubernetes.io/projected/b1423591-5924-49ef-aa8f-397afa5ff9ac-kube-api-access-kjvlw\") pod \"node-resolver-dnd5h\" (UID: \"b1423591-5924-49ef-aa8f-397afa5ff9ac\") " pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:42.864310 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.864263    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4xv\" (UniqueName: \"kubernetes.io/projected/5d4b3e91-7b1c-4803-9c39-aedc20ed3303-kube-api-access-zm4xv\") pod \"multus-9q9hc\" (UID: \"5d4b3e91-7b1c-4803-9c39-aedc20ed3303\") " pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:42.864606 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.864585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t49p4\" (UniqueName: \"kubernetes.io/projected/302ba1e5-c018-480e-b208-25d58c4d1993-kube-api-access-t49p4\") pod \"iptables-alerter-lg6kn\" (UID: \"302ba1e5-c018-480e-b208-25d58c4d1993\") " pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:42.864606 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.864603    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8th9r\" (UniqueName: \"kubernetes.io/projected/935c5a73-81d4-4319-90f2-038e4f695dd9-kube-api-access-8th9r\") pod \"node-ca-vfx74\" (UID: \"935c5a73-81d4-4319-90f2-038e4f695dd9\") " pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:42.867740 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.867714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbssf\" (UniqueName: \"kubernetes.io/projected/55b6e7cc-2fe2-45ac-96f4-c8389c9de11b-kube-api-access-sbssf\") pod \"aws-ebs-csi-driver-node-v6xs4\" (UID: \"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:42.940287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.940228    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" event={"ID":"67ce743d4b65ed408ad4f63a5d56e92b","Type":"ContainerStarted","Data":"ab85cdce940d8ad7e7f194034d786f9fd3351136474f04e866447be672f99f39"}
Jul 27 19:25:42.941448 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.941408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" event={"ID":"ef1a0ca089fb19d21b89d75ed9181952","Type":"ContainerStarted","Data":"6893be854552a54150558060910af5559b6e81d9c2b3351763a41e1ced467a54"}
Jul 27 19:25:42.946433 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysctl-conf\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-systemd\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-tuned\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-lib-modules\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946566    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-systemd\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/855ba6bc-d302-4d1d-b728-e39baf9c6393-dbus\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8698268-9532-4b4f-837c-0a2ae30f6dd8-tmp\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsvx6\" (UniqueName: \"kubernetes.io/projected/c8698268-9532-4b4f-837c-0a2ae30f6dd8-kube-api-access-hsvx6\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysctl-conf\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.946643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/855ba6bc-d302-4d1d-b728-e39baf9c6393-kubelet-config\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-sys\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysconfig\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-lib-modules\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.946726    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-kubernetes\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-host\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:42.946794    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret podName:855ba6bc-d302-4d1d-b728-e39baf9c6393 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:43.446773079 +0000 UTC m=+3.142329169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret") pod "global-pull-secret-syncer-x2hh9" (UID: "855ba6bc-d302-4d1d-b728-e39baf9c6393") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysctl-d\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-host\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-modprobe-d\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946893    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-var-lib-kubelet\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946897    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-sys\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-run\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysconfig\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.947000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-kubernetes\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.946791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/855ba6bc-d302-4d1d-b728-e39baf9c6393-kubelet-config\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.947181 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.947055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/855ba6bc-d302-4d1d-b728-e39baf9c6393-dbus\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:42.947781 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.947121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-var-lib-kubelet\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947781 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.947133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-sysctl-d\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947781 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.947181    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-run\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.947781 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.947208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-modprobe-d\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.949432 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.949408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8698268-9532-4b4f-837c-0a2ae30f6dd8-etc-tuned\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.949693 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.949667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8698268-9532-4b4f-837c-0a2ae30f6dd8-tmp\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:42.955160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:42.955106    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsvx6\" (UniqueName: \"kubernetes.io/projected/c8698268-9532-4b4f-837c-0a2ae30f6dd8-kube-api-access-hsvx6\") pod \"tuned-jqkf4\" (UID: \"c8698268-9532-4b4f-837c-0a2ae30f6dd8\") " pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:43.029799 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.029756    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4"
Jul 27 19:25:43.039259 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.039235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:25:43.050259 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.050235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9q9hc"
Jul 27 19:25:43.056472 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.056441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:25:43.064173 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.064148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnd5h"
Jul 27 19:25:43.070938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.070914    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vfx74"
Jul 27 19:25:43.079606 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.079583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lg6kn"
Jul 27 19:25:43.087550 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.087531    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:25:43.094404 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.094384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jqkf4"
Jul 27 19:25:43.349576 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.349485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:43.349725 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.349616    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:43.349725 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.349676    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.349659828 +0000 UTC m=+4.045215902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:43.450866 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.450813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:43.451032 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.450877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:43.451032 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.450990    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:43.451032 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.451011    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:25:43.451032 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.451034    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:25:43.451245 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.451048    2559 projected.go:196] Error preparing data for projected volume kube-api-access-m7llt for pod openshift-network-diagnostics/network-check-target-fr7pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:43.451245 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.451082    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret podName:855ba6bc-d302-4d1d-b728-e39baf9c6393 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.451062889 +0000 UTC m=+4.146618981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret") pod "global-pull-secret-syncer-x2hh9" (UID: "855ba6bc-d302-4d1d-b728-e39baf9c6393") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:43.451245 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:43.451104    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt podName:8e5dc63c-1fe2-42fb-8ce7-373b13831df8 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.451094475 +0000 UTC m=+4.146650550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7llt" (UniqueName: "kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt") pod "network-check-target-fr7pm" (UID: "8e5dc63c-1fe2-42fb-8ce7-373b13831df8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:43.790140 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.790075    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:20:42 +0000 UTC" deadline="2028-03-05 16:13:56.848737014 +0000 UTC"
Jul 27 19:25:43.790140 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:43.790128    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14084h48m13.058613643s"
Jul 27 19:25:43.964166 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.964139    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445d35f0_1473_4e0d_b15a_f867170652e1.slice/crio-b5d668e304362140f8f4a4857b9ac430c9961d01333bc264f9df4974fe34c4ea WatchSource:0}: Error finding container b5d668e304362140f8f4a4857b9ac430c9961d01333bc264f9df4974fe34c4ea: Status 404 returned error can't find the container with id b5d668e304362140f8f4a4857b9ac430c9961d01333bc264f9df4974fe34c4ea
Jul 27 19:25:43.965151 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.965042    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139e1d59_13a4_4234_8dba_986ab727ef52.slice/crio-906ebe1e7828b63173e5905225f58807a5b6144b46bd228e09baadd87e9de044 WatchSource:0}: Error finding container 906ebe1e7828b63173e5905225f58807a5b6144b46bd228e09baadd87e9de044: Status 404 returned error can't find the container with id 906ebe1e7828b63173e5905225f58807a5b6144b46bd228e09baadd87e9de044
Jul 27 19:25:43.967464 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.967355    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302ba1e5_c018_480e_b208_25d58c4d1993.slice/crio-a20e048178c19beff5e9f2219f2db64b513fe7ec2cbad4e4eaeeed2e526b48ea WatchSource:0}: Error finding container a20e048178c19beff5e9f2219f2db64b513fe7ec2cbad4e4eaeeed2e526b48ea: Status 404 returned error can't find the container with id a20e048178c19beff5e9f2219f2db64b513fe7ec2cbad4e4eaeeed2e526b48ea
Jul 27 19:25:43.967717 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.967694    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1423591_5924_49ef_aa8f_397afa5ff9ac.slice/crio-b086bb0a19ac1343cd3d16819dfa6d649aba2ea16b530627175521372a0662d3 WatchSource:0}: Error finding container b086bb0a19ac1343cd3d16819dfa6d649aba2ea16b530627175521372a0662d3: Status 404 returned error can't find the container with id b086bb0a19ac1343cd3d16819dfa6d649aba2ea16b530627175521372a0662d3
Jul 27 19:25:43.969522 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.969438    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4b3e91_7b1c_4803_9c39_aedc20ed3303.slice/crio-cd96c60b6c2b6e5d3f26d0bc64636ec6da5dea4decf96d3047a7e3282e027fb1 WatchSource:0}: Error finding container cd96c60b6c2b6e5d3f26d0bc64636ec6da5dea4decf96d3047a7e3282e027fb1: Status 404 returned error can't find the container with id cd96c60b6c2b6e5d3f26d0bc64636ec6da5dea4decf96d3047a7e3282e027fb1
Jul 27 19:25:43.970403 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.970384    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b6e7cc_2fe2_45ac_96f4_c8389c9de11b.slice/crio-7591ac8c43bbdb10201f57b6dd4a3e5ed4796451687fcb64cac4827c9f1cfed1 WatchSource:0}: Error finding container 7591ac8c43bbdb10201f57b6dd4a3e5ed4796451687fcb64cac4827c9f1cfed1: Status 404 returned error can't find the container with id 7591ac8c43bbdb10201f57b6dd4a3e5ed4796451687fcb64cac4827c9f1cfed1
Jul 27 19:25:43.972395 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.972357    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab06e64b_b71c_47e2_b5e9_85941805ae44.slice/crio-001f46127ebc2d899e816e9c45bf2120d8e7bffc4a3be7f2aa9e242854728cef WatchSource:0}: Error finding container 001f46127ebc2d899e816e9c45bf2120d8e7bffc4a3be7f2aa9e242854728cef: Status 404 returned error can't find the container with id 001f46127ebc2d899e816e9c45bf2120d8e7bffc4a3be7f2aa9e242854728cef
Jul 27 19:25:43.972780 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:25:43.972761    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8698268_9532_4b4f_837c_0a2ae30f6dd8.slice/crio-c73c465141dde062a684d990f6f779c50ca423c7c8eecc5440481189e4343893 WatchSource:0}: Error finding container c73c465141dde062a684d990f6f779c50ca423c7c8eecc5440481189e4343893: Status 404 returned error can't find the container with id c73c465141dde062a684d990f6f779c50ca423c7c8eecc5440481189e4343893
Jul 27 19:25:44.359133 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.358792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:44.359133 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.359073    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:44.359359 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.359155    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:46.359134595 +0000 UTC m=+6.054690680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:44.460351 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.460268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:44.460509 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.460419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:44.460693 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.460648    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:25:44.460768 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.460704    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:25:44.460768 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.460716    2559 projected.go:196] Error preparing data for projected volume kube-api-access-m7llt for pod openshift-network-diagnostics/network-check-target-fr7pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:44.460888 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.460811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt podName:8e5dc63c-1fe2-42fb-8ce7-373b13831df8 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:46.460790884 +0000 UTC m=+6.156346979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7llt" (UniqueName: "kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt") pod "network-check-target-fr7pm" (UID: "8e5dc63c-1fe2-42fb-8ce7-373b13831df8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:44.461430 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.461409    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:44.461527 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.461464    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret podName:855ba6bc-d302-4d1d-b728-e39baf9c6393 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:46.461449428 +0000 UTC m=+6.157005506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret") pod "global-pull-secret-syncer-x2hh9" (UID: "855ba6bc-d302-4d1d-b728-e39baf9c6393") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:44.790618 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.790574    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:20:42 +0000 UTC" deadline="2028-04-17 14:34:45.213411148 +0000 UTC"
Jul 27 19:25:44.790618 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.790615    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15115h9m0.422800651s"
Jul 27 19:25:44.938269 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.938242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:44.938434 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.938378    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:44.938509 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.938458    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:44.938560 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.938528    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:44.938619 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.938600    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:44.938694 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:44.938675    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:44.952368 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.952291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfx74" event={"ID":"935c5a73-81d4-4319-90f2-038e4f695dd9","Type":"ContainerStarted","Data":"1720f2f39a08087b7628933747edb15e31d42b067c83efc9059a756a3db484cf"}
Jul 27 19:25:44.963445 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.963005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" event={"ID":"ef1a0ca089fb19d21b89d75ed9181952","Type":"ContainerStarted","Data":"48be223b48f438be70fb80a0a508f4d27086da83d8a4c056f0888654aba1bc31"}
Jul 27 19:25:44.973523 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.973472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jqkf4" event={"ID":"c8698268-9532-4b4f-837c-0a2ae30f6dd8","Type":"ContainerStarted","Data":"c73c465141dde062a684d990f6f779c50ca423c7c8eecc5440481189e4343893"}
Jul 27 19:25:44.979357 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.979304    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-166.ec2.internal" podStartSLOduration=3.979286856 podStartE2EDuration="3.979286856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:44.978633267 +0000 UTC m=+4.674189362" watchObservedRunningTime="2026-07-27 19:25:44.979286856 +0000 UTC m=+4.674842951"
Jul 27 19:25:44.993716 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.993683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"001f46127ebc2d899e816e9c45bf2120d8e7bffc4a3be7f2aa9e242854728cef"}
Jul 27 19:25:45.001867 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:44.998076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lg6kn" event={"ID":"302ba1e5-c018-480e-b208-25d58c4d1993","Type":"ContainerStarted","Data":"a20e048178c19beff5e9f2219f2db64b513fe7ec2cbad4e4eaeeed2e526b48ea"}
Jul 27 19:25:45.001867 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:45.001632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9vrm" event={"ID":"139e1d59-13a4-4234-8dba-986ab727ef52","Type":"ContainerStarted","Data":"906ebe1e7828b63173e5905225f58807a5b6144b46bd228e09baadd87e9de044"}
Jul 27 19:25:45.007454 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:45.007424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerStarted","Data":"b5d668e304362140f8f4a4857b9ac430c9961d01333bc264f9df4974fe34c4ea"}
Jul 27 19:25:45.018479 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:45.018447    2559 generic.go:356] "Generic (PLEG): container finished" podID="67ce743d4b65ed408ad4f63a5d56e92b" containerID="8078c25f09accfe0f8e3361281a3cfe3bb452646ce3850fdf88b9bf1aab93cdc" exitCode=0
Jul 27 19:25:45.018644 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:45.018528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" event={"ID":"67ce743d4b65ed408ad4f63a5d56e92b","Type":"ContainerDied","Data":"8078c25f09accfe0f8e3361281a3cfe3bb452646ce3850fdf88b9bf1aab93cdc"}
Jul 27 19:25:45.032797 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:45.032756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4" event={"ID":"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b","Type":"ContainerStarted","Data":"7591ac8c43bbdb10201f57b6dd4a3e5ed4796451687fcb64cac4827c9f1cfed1"}
Jul 27 19:25:45.040655 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:45.040586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9q9hc" event={"ID":"5d4b3e91-7b1c-4803-9c39-aedc20ed3303","Type":"ContainerStarted","Data":"cd96c60b6c2b6e5d3f26d0bc64636ec6da5dea4decf96d3047a7e3282e027fb1"}
Jul 27 19:25:45.046651 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:45.046578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnd5h" event={"ID":"b1423591-5924-49ef-aa8f-397afa5ff9ac","Type":"ContainerStarted","Data":"b086bb0a19ac1343cd3d16819dfa6d649aba2ea16b530627175521372a0662d3"}
Jul 27 19:25:46.064153 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.063914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" event={"ID":"67ce743d4b65ed408ad4f63a5d56e92b","Type":"ContainerStarted","Data":"0c288a79fd08ac7ab2eea4b2ee9d4c329375162aa7627f36578dec63ba28b561"}
Jul 27 19:25:46.081983 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.081679    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-166.ec2.internal" podStartSLOduration=5.081656758 podStartE2EDuration="5.081656758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:46.080806778 +0000 UTC m=+5.776362873" watchObservedRunningTime="2026-07-27 19:25:46.081656758 +0000 UTC m=+5.777212852"
Jul 27 19:25:46.378389 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.377749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:46.378389 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.377947    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:46.378389 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.378010    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:50.377991719 +0000 UTC m=+10.073547815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:46.478766 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.478730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:46.478979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.478780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:46.478979 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.478932    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:25:46.478979 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.478949    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:25:46.478979 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.478962    2559 projected.go:196] Error preparing data for projected volume kube-api-access-m7llt for pod openshift-network-diagnostics/network-check-target-fr7pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:46.479186 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.479019    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt podName:8e5dc63c-1fe2-42fb-8ce7-373b13831df8 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:50.479004795 +0000 UTC m=+10.174560880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7llt" (UniqueName: "kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt") pod "network-check-target-fr7pm" (UID: "8e5dc63c-1fe2-42fb-8ce7-373b13831df8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:46.479593 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.479406    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:46.479593 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.479457    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret podName:855ba6bc-d302-4d1d-b728-e39baf9c6393 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:50.479443233 +0000 UTC m=+10.174999319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret") pod "global-pull-secret-syncer-x2hh9" (UID: "855ba6bc-d302-4d1d-b728-e39baf9c6393") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:46.935907 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.935868    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:46.936097 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.936016    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:46.936703 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.936398    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:46.936703 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.936489    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:46.936703 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:46.936566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:46.936703 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:46.936649    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:48.936128 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:48.936070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:48.936128 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:48.936111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:48.936659 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:48.936077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:48.936659 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:48.936209    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:48.936659 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:48.936314    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:48.936659 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:48.936370    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:50.413513 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:50.413479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:50.414003 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.413636    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:50.414003 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.413707    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:25:58.41368637 +0000 UTC m=+18.109242446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:50.514092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:50.514144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.514261    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.514275    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.514296    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.514308    2559 projected.go:196] Error preparing data for projected volume kube-api-access-m7llt for pod openshift-network-diagnostics/network-check-target-fr7pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.514336    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret podName:855ba6bc-d302-4d1d-b728-e39baf9c6393 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:58.514315637 +0000 UTC m=+18.209871711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret") pod "global-pull-secret-syncer-x2hh9" (UID: "855ba6bc-d302-4d1d-b728-e39baf9c6393") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:50.514380 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.514358    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt podName:8e5dc63c-1fe2-42fb-8ce7-373b13831df8 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:58.5143429 +0000 UTC m=+18.209898977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7llt" (UniqueName: "kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt") pod "network-check-target-fr7pm" (UID: "8e5dc63c-1fe2-42fb-8ce7-373b13831df8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:50.938024 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:50.937073    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:50.938024 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.937219    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:50.938024 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:50.937651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:50.938024 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.937783    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:50.938024 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:50.937904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:50.938024 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:50.937987    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:52.936609 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:52.936134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:52.936609 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:52.936144    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:52.936609 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:52.936269    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:52.936609 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:52.936380    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:52.936609 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:52.936148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:52.936609 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:52.936482    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:54.935946 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:54.935911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:54.936367 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:54.935911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:54.936367 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:54.936047    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:54.936367 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:54.935915    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:54.936367 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:54.936129    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:54.936367 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:54.936202    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:56.936114 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:56.936079    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:56.936607 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:56.936083    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:56.936607 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:56.936210    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:25:56.936607 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:56.936238    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:56.936607 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:56.936311    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:56.936607 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:56.936379    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:58.471583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:58.471542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:58.472068 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.471673    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:58.472068 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.471746    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:26:14.471724656 +0000 UTC m=+34.167280730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:25:58.572587 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:58.572551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:58.572746 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:58.572597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:58.572746 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.572683    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:58.572746 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.572698    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:25:58.572746 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.572713    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:25:58.572746 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.572723    2559 projected.go:196] Error preparing data for projected volume kube-api-access-m7llt for pod openshift-network-diagnostics/network-check-target-fr7pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:58.573012 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.572762    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret podName:855ba6bc-d302-4d1d-b728-e39baf9c6393 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:14.572740851 +0000 UTC m=+34.268296928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret") pod "global-pull-secret-syncer-x2hh9" (UID: "855ba6bc-d302-4d1d-b728-e39baf9c6393") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:25:58.573012 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.572782    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt podName:8e5dc63c-1fe2-42fb-8ce7-373b13831df8 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:14.572772244 +0000 UTC m=+34.268328322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7llt" (UniqueName: "kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt") pod "network-check-target-fr7pm" (UID: "8e5dc63c-1fe2-42fb-8ce7-373b13831df8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:25:58.935568 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:58.935533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:25:58.935774 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:58.935533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:25:58.935774 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.935666    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:25:58.935774 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:25:58.935688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:25:58.935967 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.935824    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:25:58.936022 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:25:58.935951    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:00.936331 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:00.936302    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:00.936331 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:00.936334    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:00.936824 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:00.936413    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:00.936824 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:00.936484    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:00.936824 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:00.936526    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:00.936824 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:00.936595    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:02.936308 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:02.935997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:02.937035 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:02.936009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:02.937035 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:02.936405    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:02.937035 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:02.936496    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:02.937035 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:02.936051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:02.937035 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:02.936652    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:03.099133 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.099088    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnd5h" event={"ID":"b1423591-5924-49ef-aa8f-397afa5ff9ac","Type":"ContainerStarted","Data":"2c57ad8b7eb4910db379152bd7286cd2ec11dfa01fc3571a202a55f9abf9397c"}
Jul 27 19:26:03.100769 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.100727    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vfx74" event={"ID":"935c5a73-81d4-4319-90f2-038e4f695dd9","Type":"ContainerStarted","Data":"d0000b27bbed495d2185f4b5af2d02f131bbfbd72a37ed00033e8b1ec1b657c4"}
Jul 27 19:26:03.102315 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.102284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jqkf4" event={"ID":"c8698268-9532-4b4f-837c-0a2ae30f6dd8","Type":"ContainerStarted","Data":"445e1a05e7c7166aab8faa00d50b653240067d3e2f7c642dca7a491dcc4c2961"}
Jul 27 19:26:03.104825 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.104803    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:26:03.105572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.105154    2559 generic.go:356] "Generic (PLEG): container finished" podID="ab06e64b-b71c-47e2-b5e9-85941805ae44" containerID="644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364" exitCode=1
Jul 27 19:26:03.105572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.105219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979"}
Jul 27 19:26:03.105572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.105287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b"}
Jul 27 19:26:03.105572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.105338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622"}
Jul 27 19:26:03.105572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.105421    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerDied","Data":"644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364"}
Jul 27 19:26:03.105572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.105470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33"}
Jul 27 19:26:03.106928 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.106879    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r9vrm" event={"ID":"139e1d59-13a4-4234-8dba-986ab727ef52","Type":"ContainerStarted","Data":"9db05450e15562acc861c57113f4e8250625e81300244c851cf76a5fbee3e2ba"}
Jul 27 19:26:03.108600 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.108574    2559 generic.go:356] "Generic (PLEG): container finished" podID="445d35f0-1473-4e0d-b15a-f867170652e1" containerID="d05b4fb99f33e075f06584293bbc45c4e2a98eeaf500f5c66f1c26480923be32" exitCode=0
Jul 27 19:26:03.108774 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.108672    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerDied","Data":"d05b4fb99f33e075f06584293bbc45c4e2a98eeaf500f5c66f1c26480923be32"}
Jul 27 19:26:03.110882 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.110862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4" event={"ID":"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b","Type":"ContainerStarted","Data":"5cf8d4e8a6e9a00da115c793a426926ec88c4a7d11bba2e76458c1eaf69abed5"}
Jul 27 19:26:03.112557 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.112535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9q9hc" event={"ID":"5d4b3e91-7b1c-4803-9c39-aedc20ed3303","Type":"ContainerStarted","Data":"d55b5670ba7193151a7d427584ab4edc8d9343a53a56beb2f010e65b95af169d"}
Jul 27 19:26:03.139743 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.139697    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9q9hc" podStartSLOduration=3.358856575 podStartE2EDuration="22.139681928s" totalImagesPullingTime="18.780825353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:03.139275124 +0000 UTC m=+22.834831220" watchObservedRunningTime="2026-07-27 19:26:03.139681928 +0000 UTC m=+22.835238034"
Jul 27 19:26:03.140214 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.140170    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dnd5h" podStartSLOduration=3.85891005 podStartE2EDuration="22.140159617s" totalImagesPullingTime="18.281249567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:03.119913882 +0000 UTC m=+22.815469973" watchObservedRunningTime="2026-07-27 19:26:03.140159617 +0000 UTC m=+22.835715713"
Jul 27 19:26:03.172623 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.172580    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r9vrm" podStartSLOduration=7.616184852 podStartE2EDuration="22.172565784s" totalImagesPullingTime="14.556380932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:03.156101766 +0000 UTC m=+22.851657861" watchObservedRunningTime="2026-07-27 19:26:03.172565784 +0000 UTC m=+22.868121878"
Jul 27 19:26:03.172821 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.172792    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vfx74" podStartSLOduration=3.874447767 podStartE2EDuration="22.17278545s" totalImagesPullingTime="18.298337683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:03.172348775 +0000 UTC m=+22.867904869" watchObservedRunningTime="2026-07-27 19:26:03.17278545 +0000 UTC m=+22.868341544"
Jul 27 19:26:03.235388 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:03.235346    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jqkf4" podStartSLOduration=3.959297868 podStartE2EDuration="22.235327661s" totalImagesPullingTime="18.276029793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:03.200962318 +0000 UTC m=+22.896518423" watchObservedRunningTime="2026-07-27 19:26:03.235327661 +0000 UTC m=+22.930883755"
Jul 27 19:26:04.014385 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.014354    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:26:04.117055 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.117019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4" event={"ID":"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b","Type":"ContainerStarted","Data":"1d488c98567e9ec02098d2657d93f780d65fd4e2e2296505fd84d73610b324e2"}
Jul 27 19:26:04.120302 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.120282    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:26:04.120712 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.120672    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd"}
Jul 27 19:26:04.122286 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.122219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lg6kn" event={"ID":"302ba1e5-c018-480e-b208-25d58c4d1993","Type":"ContainerStarted","Data":"ed84fd03fca47757c3eb4d14db5e4b1b31951bb58102798b0be3a56baaeeae6c"}
Jul 27 19:26:04.137467 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.137411    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lg6kn" podStartSLOduration=4.855140239 podStartE2EDuration="23.137391736s" totalImagesPullingTime="18.282251497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:04.137285563 +0000 UTC m=+23.832841658" watchObservedRunningTime="2026-07-27 19:26:04.137391736 +0000 UTC m=+23.832947833"
Jul 27 19:26:04.673878 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.673802    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:26:04.675076 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.675052    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:26:04.809326 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.809211    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:26:04.014373245Z","UUID":"a57c3f52-d9a2-45bf-82ee-b5c805cb1354","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:26:04.810879 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.810838    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:26:04.811009 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.810902    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:26:04.935702 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.935672    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:04.935702 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.935697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:04.935989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:04.935676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:04.935989 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:04.935809    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:04.935989 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:04.935928    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:04.936157 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:04.936015    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:05.124692 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:05.124662    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:26:05.125225 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:05.125204    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r9vrm"
Jul 27 19:26:06.131185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:06.131003    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:26:06.131631 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:06.131598    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24"}
Jul 27 19:26:06.133917 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:06.133894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4" event={"ID":"55b6e7cc-2fe2-45ac-96f4-c8389c9de11b","Type":"ContainerStarted","Data":"5c3e6343551fbc04358211ef46fcc09e7ebd559eb13ad9b9026202d3a713f9a1"}
Jul 27 19:26:06.153330 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:06.153274    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6xs4" podStartSLOduration=4.392053624 podStartE2EDuration="25.153253872s" totalImagesPullingTime="20.761200248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:06.152894907 +0000 UTC m=+25.848451002" watchObservedRunningTime="2026-07-27 19:26:06.153253872 +0000 UTC m=+25.848809965"
Jul 27 19:26:06.936344 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:06.936308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:06.936344 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:06.936338    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:06.936625 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:06.936308    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:06.936625 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:06.936433    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:06.936625 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:06.936513    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:06.936625 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:06.936593    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:08.141974 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.141790    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:26:08.142733 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.142324    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a"}
Jul 27 19:26:08.142733 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.142601    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:08.142871 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.142823    2559 scope.go:117] "RemoveContainer" containerID="644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364"
Jul 27 19:26:08.145575 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.144597    2559 generic.go:356] "Generic (PLEG): container finished" podID="445d35f0-1473-4e0d-b15a-f867170652e1" containerID="afbb9b10255a2a6a6236613334b867f5a0d2ff6348b3429aea9438773da3d40d" exitCode=0
Jul 27 19:26:08.145575 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.144627    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerDied","Data":"afbb9b10255a2a6a6236613334b867f5a0d2ff6348b3429aea9438773da3d40d"}
Jul 27 19:26:08.160595 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.160577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:08.936374 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.936343    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:08.936374 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.936372    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:08.936634 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:08.936497    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:08.936634 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:08.936588    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:08.936730 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:08.936714    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:08.936828 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:08.936807    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:09.150016 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.149987    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:26:09.150446 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.150351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" event={"ID":"ab06e64b-b71c-47e2-b5e9-85941805ae44","Type":"ContainerStarted","Data":"8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490"}
Jul 27 19:26:09.150905 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.150727    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:09.154495 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.151480    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:09.167745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.167720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:09.184138 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.184079    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q" podStartSLOduration=9.600467051 podStartE2EDuration="28.184060942s" totalImagesPullingTime="18.583593891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:09.183948621 +0000 UTC m=+28.879504715" watchObservedRunningTime="2026-07-27 19:26:09.184060942 +0000 UTC m=+28.879617035"
Jul 27 19:26:09.595040 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.595013    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2hh9"]
Jul 27 19:26:09.595209 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.595136    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:09.595271 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:09.595247    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:09.598769 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.598743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gw4wp"]
Jul 27 19:26:09.598906 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.598864    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:09.598961 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:09.598944    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:09.612897 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.612875    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fr7pm"]
Jul 27 19:26:09.613006 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:09.612986    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:09.613074 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:09.613058    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:10.154271 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:10.154238    2559 generic.go:356] "Generic (PLEG): container finished" podID="445d35f0-1473-4e0d-b15a-f867170652e1" containerID="f1c85762d71b5fc245eec4be5ecc3e22bcdaa5bb68c0dca04aec6af10c8c1591" exitCode=0
Jul 27 19:26:10.154665 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:10.154325    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerDied","Data":"f1c85762d71b5fc245eec4be5ecc3e22bcdaa5bb68c0dca04aec6af10c8c1591"}
Jul 27 19:26:10.936808 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:10.936777    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:10.936996 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:10.936907    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:11.936539 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:11.936372    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:11.937004 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:11.936392    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:11.937004 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:11.936634    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:11.937004 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:11.936676    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:12.161076 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:12.161041    2559 generic.go:356] "Generic (PLEG): container finished" podID="445d35f0-1473-4e0d-b15a-f867170652e1" containerID="a19beeba9fac5b0b3ee9cfdbb506c7156a75acaf48c23f195858d801eadd3950" exitCode=0
Jul 27 19:26:12.161221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:12.161092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerDied","Data":"a19beeba9fac5b0b3ee9cfdbb506c7156a75acaf48c23f195858d801eadd3950"}
Jul 27 19:26:12.935959 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:12.935922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:12.936146 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:12.936122    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:13.935652 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:13.935617    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:13.936156 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:13.935617    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:13.936156 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:13.935779    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:13.936156 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:13.935797    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:14.488677 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:14.488627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:14.488897 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.488807    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:26:14.488973 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.488905    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:26:46.488883764 +0000 UTC m=+66.184439850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:26:14.589414 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:14.589371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:14.589596 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:14.589427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:14.589596 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.589553    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:26:14.589673 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.589623    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:26:14.589673 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.589635    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret podName:855ba6bc-d302-4d1d-b728-e39baf9c6393 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:46.589615535 +0000 UTC m=+66.285171620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret") pod "global-pull-secret-syncer-x2hh9" (UID: "855ba6bc-d302-4d1d-b728-e39baf9c6393") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:26:14.589673 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.589648    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:26:14.589673 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.589662    2559 projected.go:196] Error preparing data for projected volume kube-api-access-m7llt for pod openshift-network-diagnostics/network-check-target-fr7pm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:26:14.589835 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.589719    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt podName:8e5dc63c-1fe2-42fb-8ce7-373b13831df8 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:46.589702242 +0000 UTC m=+66.285258319 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7llt" (UniqueName: "kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt") pod "network-check-target-fr7pm" (UID: "8e5dc63c-1fe2-42fb-8ce7-373b13831df8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:26:14.936000 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:14.935969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:14.936516 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:14.936079    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:26:15.623264 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.623190    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-166.ec2.internal" event="NodeReady"
Jul 27 19:26:15.623427 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.623343    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:26:15.935361 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.935325    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:15.935531 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.935326    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:15.938465 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.938446    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xt9mb\""
Jul 27 19:26:15.938465 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.938455    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:26:15.938967 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.938448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:26:15.938967 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:15.938452    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:26:16.936206 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:16.936172    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:16.938806 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:16.938783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:26:16.939186 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:16.938847    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4682l\""
Jul 27 19:26:17.176768 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:17.176732    2559 generic.go:356] "Generic (PLEG): container finished" podID="445d35f0-1473-4e0d-b15a-f867170652e1" containerID="5f5ed18622f362e9c188e5f0aa939221b2c4cdf9483991fe159352b5e891944b" exitCode=0
Jul 27 19:26:17.176961 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:17.176773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerDied","Data":"5f5ed18622f362e9c188e5f0aa939221b2c4cdf9483991fe159352b5e891944b"}
Jul 27 19:26:18.181488 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:18.181459    2559 generic.go:356] "Generic (PLEG): container finished" podID="445d35f0-1473-4e0d-b15a-f867170652e1" containerID="1f26791f1292526964e01a637d2d2651023a87d17eb4d403618f7d826f35755b" exitCode=0
Jul 27 19:26:18.181846 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:18.181505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerDied","Data":"1f26791f1292526964e01a637d2d2651023a87d17eb4d403618f7d826f35755b"}
Jul 27 19:26:19.187345 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:19.187164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghclq" event={"ID":"445d35f0-1473-4e0d-b15a-f867170652e1","Type":"ContainerStarted","Data":"ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a"}
Jul 27 19:26:19.209719 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:19.209667    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:26:20.956949 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:20.956903    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:26:30.952665 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:30.952606    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:26:31.859954 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:31.859909    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:31.871385 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:31.871348    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:31.882212 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:31.882173    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:31.893033 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:31.892994    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:31.904004 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:31.903964    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:31Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:31.904004 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:31.903996    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:40.952514 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:40.952463    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:26:41.176031 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:41.176002    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:41.200674 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:41.200613    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:26:41.219588 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:41.219349    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:42.136234 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:42.136146    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:42.148536 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:42.148446    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:42.160714 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:42.160634    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:42.172621 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:42.172541    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:42.184299 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:42.184223    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:42Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:42.184299 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:42.184293    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:46.507451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.507394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:26:46.510523 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.510500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:26:46.517775 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:46.517758    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 19:26:46.517824 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:46.517813    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:27:50.517797998 +0000 UTC m=+130.213354070 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : secret "metrics-daemon-secret" not found
Jul 27 19:26:46.608632 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.608583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:46.608632 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.608638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:46.611206 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.611188    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:26:46.611250 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.611197    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:26:46.620913 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.620889    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:26:46.622752 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.622729    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/855ba6bc-d302-4d1d-b728-e39baf9c6393-original-pull-secret\") pod \"global-pull-secret-syncer-x2hh9\" (UID: \"855ba6bc-d302-4d1d-b728-e39baf9c6393\") " pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:46.631707 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.631685    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7llt\" (UniqueName: \"kubernetes.io/projected/8e5dc63c-1fe2-42fb-8ce7-373b13831df8-kube-api-access-m7llt\") pod \"network-check-target-fr7pm\" (UID: \"8e5dc63c-1fe2-42fb-8ce7-373b13831df8\") " pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:46.850938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.850844    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xt9mb\""
Jul 27 19:26:46.853641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.853627    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:46.858462 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:26:46.858449    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:47.112821 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.112789    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:47.112821 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208" Netns:"/var/run/netns/c14ffaec-0dcd-4903-b247-c6524f19d3c6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:26:47.112821 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:47.112821 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.112866    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208" Netns:"/var/run/netns/c14ffaec-0dcd-4903-b247-c6524f19d3c6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.112889    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208" Netns:"/var/run/netns/c14ffaec-0dcd-4903-b247-c6524f19d3c6" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:26:47.113091 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.112979    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208\\\" Netns:\\\"/var/run/netns/c14ffaec-0dcd-4903-b247-c6524f19d3c6\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=002237f6083ccf9c587ceae1c78de025eb76ef6767c2be9112aece731f0ad208;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393\\\" Path:\\\"\\\" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:26:47.117049 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.117027    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:47.117049 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545" Netns:"/var/run/netns/76fb695e-6df0-4920-9fdf-b489063a6f62" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:26:47.117049 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:47.117049 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.117066    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545" Netns:"/var/run/netns/76fb695e-6df0-4920-9fdf-b489063a6f62" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.117084    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545" Netns:"/var/run/netns/76fb695e-6df0-4920-9fdf-b489063a6f62" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:26:47.117206 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:47.117142    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545\\\" Netns:\\\"/var/run/netns/76fb695e-6df0-4920-9fdf-b489063a6f62\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=0275cf47a1533e95fcccdb24f2b14e3f63181f5a8d63ff6e643d6c501cffe545;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:26:50.951924 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:50.951869    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:26:50.974365 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:50.974219    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:26:52.302115 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:52.302031    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:52.313907 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:52.313803    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:52.325201 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:52.325120    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:52.336508 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:52.336420    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:52.348897 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:52.348791    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:52Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:26:52.348897 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:26:52.348883    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:00.936649 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:00.936619    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:00.937029 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:00.936797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:00.951271 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:00.951216    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:00.968437 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:00.968279    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:01.160788    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0" Netns:"/var/run/netns/e32ea00e-576d-4a9e-b6c6-6ec0c41a4885" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:01.160873    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0" Netns:"/var/run/netns/e32ea00e-576d-4a9e-b6c6-6ec0c41a4885" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:01.160902    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0" Netns:"/var/run/netns/e32ea00e-576d-4a9e-b6c6-6ec0c41a4885" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:01.161068 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:01.160993    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0\\\" Netns:\\\"/var/run/netns/e32ea00e-576d-4a9e-b6c6-6ec0c41a4885\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=4938b2570f682c6b9cb67f5b64136ea0dd6b8b0357238896099f3618e5a32dd0;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:27:01.936364 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:01.936322    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:01.936629 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:01.936614    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:02.155285 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.155233    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:02.155285 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398" Netns:"/var/run/netns/2f7751af-00dd-43a3-b38f-a88babca9a81" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:02.155285 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:02.155285 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.155287    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398" Netns:"/var/run/netns/2f7751af-00dd-43a3-b38f-a88babca9a81" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.155305    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398" Netns:"/var/run/netns/2f7751af-00dd-43a3-b38f-a88babca9a81" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:02.155709 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.155387    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398\\\" Netns:\\\"/var/run/netns/2f7751af-00dd-43a3-b38f-a88babca9a81\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=1270a10153f20d88eaeb831fffda6f9bd112b3943bbf2a65fbdee22f336ab398;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393\\\" Path:\\\"\\\" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:27:02.632628 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.632546    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:02.644121 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.644041    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:02.655580 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.655499    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:02.667262 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.667185    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:02.679134 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.679038    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:02Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:02.679134 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:02.679127    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:10.953990 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:10.953937    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:10.971551 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:10.971387    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:12.717941 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:12.717844    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:12.729961 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:12.729883    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:12.741401 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:12.741318    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:12.753021 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:12.752924    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:12.764277 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:12.764204    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:12Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:12.764277 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:12.764273    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:14.935610 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:14.935570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:14.936015 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:14.935739    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:14.936015 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:14.935819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:14.936015 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:14.935961    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.177576    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55" Netns:"/var/run/netns/f7934181-d56f-49d7-a8b0-a78d27538d08" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.177634    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55" Netns:"/var/run/netns/f7934181-d56f-49d7-a8b0-a78d27538d08" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.177651    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55" Netns:"/var/run/netns/f7934181-d56f-49d7-a8b0-a78d27538d08" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:15.177678 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:15.178204 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.177724    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55\\\" Netns:\\\"/var/run/netns/f7934181-d56f-49d7-a8b0-a78d27538d08\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=e404e7021741ed5ed44d4ad313af81149afd91f2c0c14effbe1306b9329c0e55;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393\\\" Path:\\\"\\\" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:27:15.207048 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.207018    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:15.207048 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea" Netns:"/var/run/netns/59198d4a-9901-4d01-b825-49000ef3cd8c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:15.207048 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:15.207048 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.207068    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea" Netns:"/var/run/netns/59198d4a-9901-4d01-b825-49000ef3cd8c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.207091    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea" Netns:"/var/run/netns/59198d4a-9901-4d01-b825-49000ef3cd8c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:15.207208 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:15.207168    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea\\\" Netns:\\\"/var/run/netns/59198d4a-9901-4d01-b825-49000ef3cd8c\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=303b93ac99d582f07ce9b536eb4e8d1089b576916214c9d6824468332e5083ea;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:27:20.952268 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:20.952201    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:20.970071 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:20.969918    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:22.966555 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:22.966472    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:22.978680 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:22.978586    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:22.990093 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:22.990009    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:23.001279 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:23.001203    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:23.012002 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:23.011922    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:23Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:23Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:23Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:23Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:23.012002 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:23.011994    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:26.935493 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:26.935455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:26.935912 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:26.935684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:27.156110    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6" Netns:"/var/run/netns/23479c2a-d8c7-4568-80fa-75cbfc42d678" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:27.156165    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6" Netns:"/var/run/netns/23479c2a-d8c7-4568-80fa-75cbfc42d678" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:27.156181    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6" Netns:"/var/run/netns/23479c2a-d8c7-4568-80fa-75cbfc42d678" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:27.156233 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:27.156702 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:27.156256    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6\\\" Netns:\\\"/var/run/netns/23479c2a-d8c7-4568-80fa-75cbfc42d678\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=1c20109b3a7c8483dcbb780098007cee454cd720fe5753d0458293de4e25aaa6;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:27:27.935538 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:27.935497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:27.935913 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:27.935732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:28.173291 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:28.173250    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:28.173291 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d" Netns:"/var/run/netns/68d50e52-3851-45f4-8ac1-10e32b1167bf" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:28.173291 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:28.173291 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:28.173325    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d" Netns:"/var/run/netns/68d50e52-3851-45f4-8ac1-10e32b1167bf" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:28.173349    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d" Netns:"/var/run/netns/68d50e52-3851-45f4-8ac1-10e32b1167bf" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:28.173499 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:28.173440    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d\\\" Netns:\\\"/var/run/netns/68d50e52-3851-45f4-8ac1-10e32b1167bf\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=628f00609fe612f145afb89b1ffd06ae766d266a434a374ea00122a21ed62e5d;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393\\\" Path:\\\"\\\" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:27:30.955811 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:30.955668    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:30.969229 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:30.969170    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:33.290472 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:33.290389    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:33.302307 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:33.302228    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:33.314748 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:33.314659    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:33.327035 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:33.326952    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:33.339215 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:33.339136    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:33Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:33.339215 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:33.339210    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:40.501549 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.501510    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55b4bd5d48-h6mvq"]
Jul 27 19:27:40.503705 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.503688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.506293 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.506269    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 19:27:40.506293 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.506286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 19:27:40.506553 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.506316    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 19:27:40.506759 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.506745    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h9pp5\""
Jul 27 19:27:40.512931 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.512912    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 19:27:40.522167 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.522142    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5b2kq"]
Jul 27 19:27:40.524248 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.524233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.526392 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.526375    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctr9s\""
Jul 27 19:27:40.526460 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.526408    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:27:40.526460 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.526426    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:27:40.528328 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.528309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"]
Jul 27 19:27:40.530269 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.530160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.530939 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.530760    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:40.532174 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.532157    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 19:27:40.532254 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.532161    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 19:27:40.532396 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.532384    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.532541 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.532514    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.546080 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.546031    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:40.552812 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.552786    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"]
Jul 27 19:27:40.554944 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.554924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.557150 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.557123    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 19:27:40.557271 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.557167    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v7v5m\""
Jul 27 19:27:40.563801 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.563915 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.563758    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.563915 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-certificates\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.563915 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-installation-pull-secrets\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.563915 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x97w\" (UniqueName: \"kubernetes.io/projected/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-kube-api-access-5x97w\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.563915 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-tmp-dir\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.564116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563936    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-image-registry-private-configuration\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.564116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-bound-sa-token\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.564116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.563996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wgq9\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-kube-api-access-6wgq9\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.564116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.564017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.564116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.564035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-config-volume\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.564116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.564057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/133b853f-ec18-4f5a-91b0-503c10284cc9-ca-trust-extracted\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.564116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.564103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-trusted-ca\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.575699 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.575649    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.585708 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.585644    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16e2a89862a2a359709d5e15ab45d48a41582b58f029f689a9703b468957426c\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"metrics-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-dns\"/\"dns-default-5b2kq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.600149 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.600098    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fec2ae87-daa0-4829-9868-36e75c205276\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"acm-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/run/klusterlet\\\",\\\"name\\\":\\\"klusterlet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-69x9w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"klusterlet-addon-workmgr-b4f56bbb-v5cp8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.624328 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.624292    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"]
Jul 27 19:27:40.626413 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.626397    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c8ldc"]
Jul 27 19:27:40.626539 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.626521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:40.628206 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.628188    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"]
Jul 27 19:27:40.628335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.628318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:40.629045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.629028    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.629045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.629037    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.629195 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.629140    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jl2g8\""
Jul 27 19:27:40.629405 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.629388    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 19:27:40.630119 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.630096    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.630696 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.630668    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nmpmh\""
Jul 27 19:27:40.630892 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.630880    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"]
Jul 27 19:27:40.631261 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.631246    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.632520 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.632504    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-vcgvv"]
Jul 27 19:27:40.632649 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.632628    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.632649 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.632645    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:40.632773 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.632742    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 19:27:40.632886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.632842    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-24nvc\""
Jul 27 19:27:40.632960 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.632882    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.632960 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.632877    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 19:27:40.633058 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.633044    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:27:40.633279 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.633261    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.633966 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.633811    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:40.634402 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.634381    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-648c8c87b9-rl85h"]
Jul 27 19:27:40.634516 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.634494    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.635100 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.635080    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.635169 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.635131    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.635169 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.635152    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mxsbt\""
Jul 27 19:27:40.636488 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.636475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.636810 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.636790    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.637065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.637022    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 19:27:40.637155 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.637080    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 19:27:40.637155 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.637086    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.637155 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.637128    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gjwtj\""
Jul 27 19:27:40.639039 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.639004    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 19:27:40.640967 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.640950    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 19:27:40.641053 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.640991    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.641286 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.641266    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 19:27:40.641499 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.641484    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 19:27:40.641615 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.641597    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wnsp8\""
Jul 27 19:27:40.641925 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.641910    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.644164 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.644147    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 19:27:40.652718 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.652659    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"12fd86af-c063-43cb-85e1-e217480dca40\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/managed/hub-kubeconfig\\\",\\\"name\\\":\\\"hub-kubeconfig\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8cmf6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"managed-serviceaccount-addon-agent-7c667796f8-6txwr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.664512 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664491    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.664598 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-certificates\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.664598 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-installation-pull-secrets\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.664713 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.664699    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:27:40.664780 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fec2ae87-daa0-4829-9868-36e75c205276-klusterlet-config\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.664840 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.664773    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls podName:f25992a9-9aaa-4bd9-aa0e-83c123afc97c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:41.164750796 +0000 UTC m=+120.860306883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls") pod "dns-default-5b2kq" (UID: "f25992a9-9aaa-4bd9-aa0e-83c123afc97c") : secret "dns-default-metrics-tls" not found
Jul 27 19:27:40.664840 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x97w\" (UniqueName: \"kubernetes.io/projected/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-kube-api-access-5x97w\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.664970 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fec2ae87-daa0-4829-9868-36e75c205276-tmp\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.664970 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-tmp-dir\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.664970 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.664934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-image-registry-private-configuration\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665105 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-bound-sa-token\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665105 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wgq9\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-kube-api-access-6wgq9\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665105 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665105 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-config-volume\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/133b853f-ec18-4f5a-91b0-503c10284cc9-ca-trust-extracted\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmf6\" (UniqueName: \"kubernetes.io/projected/12fd86af-c063-43cb-85e1-e217480dca40-kube-api-access-8cmf6\") pod \"managed-serviceaccount-addon-agent-7c667796f8-6txwr\" (UID: \"12fd86af-c063-43cb-85e1-e217480dca40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-certificates\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-tmp-dir\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-trusted-ca\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12fd86af-c063-43cb-85e1-e217480dca40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c667796f8-6txwr\" (UID: \"12fd86af-c063-43cb-85e1-e217480dca40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.665269    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:27:40.665287 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.665283    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55b4bd5d48-h6mvq: secret "image-registry-tls" not found
Jul 27 19:27:40.665554 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69x9w\" (UniqueName: \"kubernetes.io/projected/fec2ae87-daa0-4829-9868-36e75c205276-kube-api-access-69x9w\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.665554 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.665325    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls podName:133b853f-ec18-4f5a-91b0-503c10284cc9 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:41.165309009 +0000 UTC m=+120.860865098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls") pod "image-registry-55b4bd5d48-h6mvq" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9") : secret "image-registry-tls" not found
Jul 27 19:27:40.665664 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/133b853f-ec18-4f5a-91b0-503c10284cc9-ca-trust-extracted\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.665866 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.665826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-config-volume\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.666046 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.666029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-trusted-ca\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.667340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.667318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-installation-pull-secrets\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.667466 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.667447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-image-registry-private-configuration\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.668465 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.668446    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"]
Jul 27 19:27:40.671285 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.671265    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.673721 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.673696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 19:27:40.673817 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.673722    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 19:27:40.673817 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.673779    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 19:27:40.674050 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.674034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 19:27:40.677832 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.677813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x97w\" (UniqueName: \"kubernetes.io/projected/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-kube-api-access-5x97w\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:40.699214 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.696223    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:40.707014 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.706984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-bound-sa-token\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.707172 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.707065    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wgq9\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-kube-api-access-6wgq9\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:40.707399 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.707352    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fec2ae87-daa0-4829-9868-36e75c205276\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"acm-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/run/klusterlet\\\",\\\"name\\\":\\\"klusterlet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-69x9w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"klusterlet-addon-workmgr-b4f56bbb-v5cp8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.717845 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.717819    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"]
Jul 27 19:27:40.720049 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.720034    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:40.722110 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.722088    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dp7gr\""
Jul 27 19:27:40.724998 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.724894    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"]
Jul 27 19:27:40.728938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.728916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.731476 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.731448    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"]
Jul 27 19:27:40.732026 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.732002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 27 19:27:40.732143 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.732027    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 27 19:27:40.732143 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.732127    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s6hqq\""
Jul 27 19:27:40.732354 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.732338    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.732450 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.732437    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.733515 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.733502    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-r4gfr"]
Jul 27 19:27:40.733619 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.733607    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.735453 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.735432    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.735555 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.735501    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 19:27:40.735555 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.735524    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mvg6x\""
Jul 27 19:27:40.735844 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.735821    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.736293 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.736268    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.736404 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.736390    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 19:27:40.736539 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.736366    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:40.737896 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.737879    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d2wmr\""
Jul 27 19:27:40.737982 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.737972    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.738027 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.738007    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.738242 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.738229    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 19:27:40.738287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.738255    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 19:27:40.744286 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.744267    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 19:27:40.750841 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.750800    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"12fd86af-c063-43cb-85e1-e217480dca40\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/managed/hub-kubeconfig\\\",\\\"name\\\":\\\"hub-kubeconfig\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8cmf6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"managed-serviceaccount-addon-agent-7c667796f8-6txwr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.765714 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv94j\" (UniqueName: \"kubernetes.io/projected/da1a0f98-21f8-4874-9c69-804469078a0a-kube-api-access-nv94j\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.765818 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.765818 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1a0f98-21f8-4874-9c69-804469078a0a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.765818 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fec2ae87-daa0-4829-9868-36e75c205276-tmp\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.766056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.766056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.766056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765948    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0a9cc75-3c38-4758-9674-64a5e4ef0612-tmp\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.766056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a9cc75-3c38-4758-9674-64a5e4ef0612-service-ca-bundle\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.766056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.765999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a9cc75-3c38-4758-9674-64a5e4ef0612-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.766056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mznc8\" (UniqueName: \"kubernetes.io/projected/f18b87cf-93b3-4ba6-8260-2efcfee5be08-kube-api-access-mznc8\") pod \"ingress-canary-c8ldc\" (UID: \"f18b87cf-93b3-4ba6-8260-2efcfee5be08\") " pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:40.766056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766050    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fec2ae87-daa0-4829-9868-36e75c205276-tmp\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmf6\" (UniqueName: \"kubernetes.io/projected/12fd86af-c063-43cb-85e1-e217480dca40-kube-api-access-8cmf6\") pod \"managed-serviceaccount-addon-agent-7c667796f8-6txwr\" (UID: \"12fd86af-c063-43cb-85e1-e217480dca40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f18b87cf-93b3-4ba6-8260-2efcfee5be08-cert\") pod \"ingress-canary-c8ldc\" (UID: \"f18b87cf-93b3-4ba6-8260-2efcfee5be08\") " pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgzj\" (UniqueName: \"kubernetes.io/projected/3a954648-6bb0-4672-817b-bfcb20c925db-kube-api-access-rzgzj\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766237    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fec2ae87-daa0-4829-9868-36e75c205276-klusterlet-config\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q299\" (UniqueName: \"kubernetes.io/projected/0a8a7150-5c04-48c1-be16-9ea34bc9d937-kube-api-access-2q299\") pod \"volume-data-source-validator-549c6d54cf-v22x8\" (UID: \"0a8a7150-5c04-48c1-be16-9ea34bc9d937\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-default-certificate\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.766349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-stats-auth\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdv9\" (UniqueName: \"kubernetes.io/projected/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-kube-api-access-nkdv9\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lshv\" (UniqueName: \"kubernetes.io/projected/d0a9cc75-3c38-4758-9674-64a5e4ef0612-kube-api-access-5lshv\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdcrz\" (UniqueName: \"kubernetes.io/projected/597d0836-1571-439a-a7d6-2d4700cfadfa-kube-api-access-sdcrz\") pod \"network-check-source-7d88cb55d8-v664j\" (UID: \"597d0836-1571-439a-a7d6-2d4700cfadfa\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-hub\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0a9cc75-3c38-4758-9674-64a5e4ef0612-serving-cert\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12fd86af-c063-43cb-85e1-e217480dca40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c667796f8-6txwr\" (UID: \"12fd86af-c063-43cb-85e1-e217480dca40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d0a9cc75-3c38-4758-9674-64a5e4ef0612-snapshots\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-ca\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrfm2\" (UniqueName: \"kubernetes.io/projected/501c4043-9669-4f01-bb1b-8ffdd7498bfa-kube-api-access-mrfm2\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:40.766683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.766576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69x9w\" (UniqueName: \"kubernetes.io/projected/fec2ae87-daa0-4829-9868-36e75c205276-kube-api-access-69x9w\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.768610 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.768591    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 19:27:40.768681 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.768593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 27 19:27:40.771142 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.771098    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"501c4043-9669-4f01-bb1b-8ffdd7498bfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"samples-operator-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator-watch\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-samples-operator\"/\"cluster-samples-operator-6748489656-8xvd2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:40.779725 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.779702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fec2ae87-daa0-4829-9868-36e75c205276-klusterlet-config\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.779826 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.779703    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12fd86af-c063-43cb-85e1-e217480dca40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c667796f8-6txwr\" (UID: \"12fd86af-c063-43cb-85e1-e217480dca40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.783594 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.783576    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 19:27:40.794037 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.793993    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nkdv9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.795399 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.795384    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 19:27:40.804327 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.804303    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmf6\" (UniqueName: \"kubernetes.io/projected/12fd86af-c063-43cb-85e1-e217480dca40-kube-api-access-8cmf6\") pod \"managed-serviceaccount-addon-agent-7c667796f8-6txwr\" (UID: \"12fd86af-c063-43cb-85e1-e217480dca40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:40.804394 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.804347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69x9w\" (UniqueName: \"kubernetes.io/projected/fec2ae87-daa0-4829-9868-36e75c205276-kube-api-access-69x9w\") pod \"klusterlet-addon-workmgr-b4f56bbb-v5cp8\" (UID: \"fec2ae87-daa0-4829-9868-36e75c205276\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.820249 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.820201    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a8a7150-5c04-48c1-be16-9ea34bc9d937\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:38be0cf7145e21615b72b12be031fd2071873afe8d11ac5b734b10e1e66fb357\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"volume-data-source-validator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2q299\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-storage-operator\"/\"volume-data-source-validator-549c6d54cf-v22x8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:40.841679 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.841654    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 19:27:40.849916 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.849898    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:40.856088 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.856019    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0a9cc75-3c38-4758-9674-64a5e4ef0612\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5lshv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-vcgvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.867488 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d0a9cc75-3c38-4758-9674-64a5e4ef0612-snapshots\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.867488 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-ca\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrfm2\" (UniqueName: \"kubernetes.io/projected/501c4043-9669-4f01-bb1b-8ffdd7498bfa-kube-api-access-mrfm2\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv94j\" (UniqueName: \"kubernetes.io/projected/da1a0f98-21f8-4874-9c69-804469078a0a-kube-api-access-nv94j\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1a0f98-21f8-4874-9c69-804469078a0a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-config\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-297pb\" (UniqueName: \"kubernetes.io/projected/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-kube-api-access-297pb\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.867663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.868083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.868083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867719    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2b78ebb-f09f-4caf-88d7-3c37b2276539-trusted-ca\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.868083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.868083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0a9cc75-3c38-4758-9674-64a5e4ef0612-tmp\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.868083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a9cc75-3c38-4758-9674-64a5e4ef0612-service-ca-bundle\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.868083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.867906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a9cc75-3c38-4758-9674-64a5e4ef0612-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.868083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznc8\" (UniqueName: \"kubernetes.io/projected/f18b87cf-93b3-4ba6-8260-2efcfee5be08-kube-api-access-mznc8\") pod \"ingress-canary-c8ldc\" (UID: \"f18b87cf-93b3-4ba6-8260-2efcfee5be08\") " pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d0a9cc75-3c38-4758-9674-64a5e4ef0612-snapshots\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868169    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d0a9cc75-3c38-4758-9674-64a5e4ef0612-tmp\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f18b87cf-93b3-4ba6-8260-2efcfee5be08-cert\") pod \"ingress-canary-c8ldc\" (UID: \"f18b87cf-93b3-4ba6-8260-2efcfee5be08\") " pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/da1a0f98-21f8-4874-9c69-804469078a0a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2b78ebb-f09f-4caf-88d7-3c37b2276539-serving-cert\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.868391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.868666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztd8h\" (UniqueName: \"kubernetes.io/projected/a2b78ebb-f09f-4caf-88d7-3c37b2276539-kube-api-access-ztd8h\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.868666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgzj\" (UniqueName: \"kubernetes.io/projected/3a954648-6bb0-4672-817b-bfcb20c925db-kube-api-access-rzgzj\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.868666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:40.868666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q299\" (UniqueName: \"kubernetes.io/projected/0a8a7150-5c04-48c1-be16-9ea34bc9d937-kube-api-access-2q299\") pod \"volume-data-source-validator-549c6d54cf-v22x8\" (UID: \"0a8a7150-5c04-48c1-be16-9ea34bc9d937\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:40.868666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-default-certificate\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.868666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-stats-auth\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.868894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdv9\" (UniqueName: \"kubernetes.io/projected/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-kube-api-access-nkdv9\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.868894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lshv\" (UniqueName: \"kubernetes.io/projected/d0a9cc75-3c38-4758-9674-64a5e4ef0612-kube-api-access-5lshv\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.868894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdcrz\" (UniqueName: \"kubernetes.io/projected/597d0836-1571-439a-a7d6-2d4700cfadfa-kube-api-access-sdcrz\") pod \"network-check-source-7d88cb55d8-v664j\" (UID: \"597d0836-1571-439a-a7d6-2d4700cfadfa\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:40.868894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2b78ebb-f09f-4caf-88d7-3c37b2276539-config\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.868894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-hub\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.868894 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0a9cc75-3c38-4758-9674-64a5e4ef0612-serving-cert\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.869092 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.869092 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.868944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlxrl\" (UniqueName: \"kubernetes.io/projected/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-kube-api-access-zlxrl\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.870751 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.870730    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 19:27:40.871134 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.871113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 19:27:40.871226 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.871113    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 19:27:40.871892 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.871877    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:27:40.872943 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.872924    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 27 19:27:40.873439 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.873402    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 27 19:27:40.878511 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.878495    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:41.378477533 +0000 UTC m=+121.074033606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : configmap references non-existent config key: service-ca.crt
Jul 27 19:27:40.878632 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.878565    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:27:40.878703 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.878639    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:41.378620217 +0000 UTC m=+121.074176290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : secret "router-metrics-certs-default" not found
Jul 27 19:27:40.879179 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.879154    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.879279 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.879216    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a9cc75-3c38-4758-9674-64a5e4ef0612-service-ca-bundle\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.880933 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.880906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f18b87cf-93b3-4ba6-8260-2efcfee5be08-cert\") pod \"ingress-canary-c8ldc\" (UID: \"f18b87cf-93b3-4ba6-8260-2efcfee5be08\") " pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:40.881364 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.881346    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-ca\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.882224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.882203    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 19:27:40.883231 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.883213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv94j\" (UniqueName: \"kubernetes.io/projected/da1a0f98-21f8-4874-9c69-804469078a0a-kube-api-access-nv94j\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.885997 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.885977    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 19:27:40.886834 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.886777    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a954648-6bb0-4672-817b-bfcb20c925db\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"router\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/private\\\",\\\"name\\\":\\\"default-certificate\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/haproxy/conf/metrics-auth\\\",\\\"name\\\":\\\"stats-auth\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rzgzj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress\"/\"router-default-648c8c87b9-rl85h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.889378 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.889359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0a9cc75-3c38-4758-9674-64a5e4ef0612-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:40.890250 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.890233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:40.906740 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.906719    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 19:27:40.910231 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.910208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:40.936322 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.936306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:40.936537 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.936526    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:40.946625 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.946601    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 27 19:27:40.951377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.951357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-default-certificate\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:40.966832 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.966804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.969651    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.969714    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls podName:501c4043-9669-4f01-bb1b-8ffdd7498bfa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:41.469698421 +0000 UTC m=+121.165254496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls") pod "cluster-samples-operator-6748489656-8xvd2" (UID: "501c4043-9669-4f01-bb1b-8ffdd7498bfa") : secret "samples-operator-tls" not found
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.969995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2b78ebb-f09f-4caf-88d7-3c37b2276539-trusted-ca\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2b78ebb-f09f-4caf-88d7-3c37b2276539-serving-cert\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztd8h\" (UniqueName: \"kubernetes.io/projected/a2b78ebb-f09f-4caf-88d7-3c37b2276539-kube-api-access-ztd8h\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2b78ebb-f09f-4caf-88d7-3c37b2276539-config\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlxrl\" (UniqueName: \"kubernetes.io/projected/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-kube-api-access-zlxrl\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970347    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-config\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.970969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.970407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-297pb\" (UniqueName: \"kubernetes.io/projected/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-kube-api-access-297pb\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.971703 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.971136    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:40.971703 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:40.971199    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls podName:36a1b7d0-2ff0-499f-a375-5eca85ae7b3c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:41.47118307 +0000 UTC m=+121.166739148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mmxrs" (UID: "36a1b7d0-2ff0-499f-a375-5eca85ae7b3c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:40.971815 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.971718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:40.972261 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.972213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2b78ebb-f09f-4caf-88d7-3c37b2276539-trusted-ca\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.972357 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.972227    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-config\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.972428 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.972407    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2b78ebb-f09f-4caf-88d7-3c37b2276539-config\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.976010 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.973582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:40.976010 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.974031    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2b78ebb-f09f-4caf-88d7-3c37b2276539-serving-cert\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:40.986669 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.986640    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 27 19:27:40.991105 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:40.991080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-stats-auth\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:41.034532 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.034504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdcrz\" (UniqueName: \"kubernetes.io/projected/597d0836-1571-439a-a7d6-2d4700cfadfa-kube-api-access-sdcrz\") pod \"network-check-source-7d88cb55d8-v664j\" (UID: \"597d0836-1571-439a-a7d6-2d4700cfadfa\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:41.042965 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.042937    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:41.066935 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.066906    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 19:27:41.072379 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.072349    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-hub\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:41.106291 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.106267    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 19:27:41.111299 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.111281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/da1a0f98-21f8-4874-9c69-804469078a0a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8459dbd967-b6s2l\" (UID: \"da1a0f98-21f8-4874-9c69-804469078a0a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:41.118157 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.118132    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"]
Jul 27 19:27:41.121009 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.120994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:41.126234 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.126215    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 19:27:41.131049 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.131027    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0a9cc75-3c38-4758-9674-64a5e4ef0612-serving-cert\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:41.148947 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.148919    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v7v5m\""
Jul 27 19:27:41.151953 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.151930    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:41.155265 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.155242    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:41.155265 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997" Netns:"/var/run/netns/86522d30-0772-45b0-955a-53c60e4fe927" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:41.155265 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:41.155265 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.155281    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997" Netns:"/var/run/netns/86522d30-0772-45b0-955a-53c60e4fe927" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.155300    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997" Netns:"/var/run/netns/86522d30-0772-45b0-955a-53c60e4fe927" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8" Path:"" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]:  > pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:41.155509 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.155361    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"network-check-target-fr7pm_openshift-network-diagnostics(8e5dc63c-1fe2-42fb-8ce7-373b13831df8)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_network-check-target-fr7pm_openshift-network-diagnostics_8e5dc63c-1fe2-42fb-8ce7-373b13831df8_0(29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997): error adding pod openshift-network-diagnostics_network-check-target-fr7pm to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997\\\" Netns:\\\"/var/run/netns/86522d30-0772-45b0-955a-53c60e4fe927\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-network-diagnostics;K8S_POD_NAME=network-check-target-fr7pm;K8S_POD_INFRA_CONTAINER_ID=29f6d85ded44e047c073c4e7e6e933c7ce6b43f62432e06c2670c71ab56eb997;K8S_POD_UID=8e5dc63c-1fe2-42fb-8ce7-373b13831df8\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-network-diagnostics/network-check-target-fr7pm] networking: Multus: [openshift-network-diagnostics/network-check-target-fr7pm/8e5dc63c-1fe2-42fb-8ce7-373b13831df8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod network-check-target-fr7pm in out of cluster comm: SetNetworkStatus: failed to update the pod network-check-target-fr7pm in out of cluster comm: status update failed for pod openshift-network-diagnostics/network-check-target-fr7pm: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-network-diagnostics/network-check-target-fr7pm" podUID="8e5dc63c-1fe2-42fb-8ce7-373b13831df8"
Jul 27 19:27:41.166343 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.166322    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:41.172678 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.172655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03221ef7-ec98-4d51-8ed9-9564a1ae597b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:41.172791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.172751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:41.172842 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.172826    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:27:41.172891 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.172845    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55b4bd5d48-h6mvq: secret "image-registry-tls" not found
Jul 27 19:27:41.172891 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.172870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:41.172969 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.172903    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls podName:133b853f-ec18-4f5a-91b0-503c10284cc9 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:42.172889003 +0000 UTC m=+121.868445074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls") pod "image-registry-55b4bd5d48-h6mvq" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9") : secret "image-registry-tls" not found
Jul 27 19:27:41.172969 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.172919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:41.173043 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.173019    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:27:41.173086 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.173074    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls podName:f25992a9-9aaa-4bd9-aa0e-83c123afc97c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:42.173058752 +0000 UTC m=+121.868614844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls") pod "dns-default-5b2kq" (UID: "f25992a9-9aaa-4bd9-aa0e-83c123afc97c") : secret "dns-default-metrics-tls" not found
Jul 27 19:27:41.186196 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.186172    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:27:41.226790 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.226767    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:27:41.253571 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.253547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-297pb\" (UniqueName: \"kubernetes.io/projected/613f0bd9-0f9f-4a89-87e8-b9e2db5be64a-kube-api-access-297pb\") pod \"service-ca-operator-5d6c75f84f-8c56f\" (UID: \"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:41.271759 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.271700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlxrl\" (UniqueName: \"kubernetes.io/projected/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-kube-api-access-zlxrl\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:41.273710 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.273692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03221ef7-ec98-4d51-8ed9-9564a1ae597b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:41.273827 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.273813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:41.291023 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.291001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztd8h\" (UniqueName: \"kubernetes.io/projected/a2b78ebb-f09f-4caf-88d7-3c37b2276539-kube-api-access-ztd8h\") pod \"console-operator-584dcb6b54-r4gfr\" (UID: \"a2b78ebb-f09f-4caf-88d7-3c37b2276539\") " pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:41.306406 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.306380    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:41.311655 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.311631    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:41.326240 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.326217    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:27:41.347466 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.346799    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 19:27:41.349903 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.349882    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:41.361349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.361329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:41.366296 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.366274    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nq2nz\""
Jul 27 19:27:41.386936 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.386907    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 19:27:41.394078 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.394054    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:27:41.394199 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.394119    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert podName:03221ef7-ec98-4d51-8ed9-9564a1ae597b nodeName:}" failed. No retries permitted until 2026-07-27 19:27:41.894103641 +0000 UTC m=+121.589659713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tgfb5" (UID: "03221ef7-ec98-4d51-8ed9-9564a1ae597b") : secret "networking-console-plugin-cert" not found
Jul 27 19:27:41.406165 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.406137    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 19:27:41.414609 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.414582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03221ef7-ec98-4d51-8ed9-9564a1ae597b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:41.426284 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.426261    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:41.434430 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.434406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrfm2\" (UniqueName: \"kubernetes.io/projected/501c4043-9669-4f01-bb1b-8ffdd7498bfa-kube-api-access-mrfm2\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:41.446114 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.446099    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:27:41.456155 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.456129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mznc8\" (UniqueName: \"kubernetes.io/projected/f18b87cf-93b3-4ba6-8260-2efcfee5be08-kube-api-access-mznc8\") pod \"ingress-canary-c8ldc\" (UID: \"f18b87cf-93b3-4ba6-8260-2efcfee5be08\") " pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:41.475167 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475121    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:41.475320 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.475303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:41.475373 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.475348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:41.475420 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.475393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:41.475465 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.475431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:41.475515 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475465    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:41.475559 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475511    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:27:41.475559 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475539    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:27:41.475644 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475537    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls podName:36a1b7d0-2ff0-499f-a375-5eca85ae7b3c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:42.475517535 +0000 UTC m=+122.171073631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mmxrs" (UID: "36a1b7d0-2ff0-499f-a375-5eca85ae7b3c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:41.475644 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475598    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls podName:501c4043-9669-4f01-bb1b-8ffdd7498bfa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:42.475587353 +0000 UTC m=+122.171143425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls") pod "cluster-samples-operator-6748489656-8xvd2" (UID: "501c4043-9669-4f01-bb1b-8ffdd7498bfa") : secret "samples-operator-tls" not found
Jul 27 19:27:41.475644 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475612    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:42.475606328 +0000 UTC m=+122.171162400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : configmap references non-existent config key: service-ca.crt
Jul 27 19:27:41.475644 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.475623    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:42.475618312 +0000 UTC m=+122.171174384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : secret "router-metrics-certs-default" not found
Jul 27 19:27:41.485965 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.485945    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:27:41.492806 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.492788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgzj\" (UniqueName: \"kubernetes.io/projected/3a954648-6bb0-4672-817b-bfcb20c925db-kube-api-access-rzgzj\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:41.506055 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.506034    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:41.513095 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.513068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q299\" (UniqueName: \"kubernetes.io/projected/0a8a7150-5c04-48c1-be16-9ea34bc9d937-kube-api-access-2q299\") pod \"volume-data-source-validator-549c6d54cf-v22x8\" (UID: \"0a8a7150-5c04-48c1-be16-9ea34bc9d937\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:41.526997 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.526937    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:27:41.534810 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.534788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lshv\" (UniqueName: \"kubernetes.io/projected/d0a9cc75-3c38-4758-9674-64a5e4ef0612-kube-api-access-5lshv\") pod \"insights-operator-5885fdb759-vcgvv\" (UID: \"d0a9cc75-3c38-4758-9674-64a5e4ef0612\") " pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:41.546782 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.546766    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:27:41.553569 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.553545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdv9\" (UniqueName: \"kubernetes.io/projected/f9094e27-933d-4f5e-ba44-6ddc0d76a6f4-kube-api-access-nkdv9\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\" (UID: \"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:41.586744 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.586723    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nmpmh\""
Jul 27 19:27:41.595619 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.595602    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:41.606118 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.606103    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mxsbt\""
Jul 27 19:27:41.607087 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.607073    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:41.626764 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.626733    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gjwtj\""
Jul 27 19:27:41.632595 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.632568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:41.653727 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.653672    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:41.692099 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.692045    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f18b87cf-93b3-4ba6-8260-2efcfee5be08\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"serve-healthcheck-canary\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls-cert\\\",\\\"name\\\":\\\"cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mznc8\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress-canary\"/\"ingress-canary-c8ldc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:41.733639 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.733565    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"da1a0f98-21f8-4874-9c69-804469078a0a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"proxy-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ca\\\",\\\"name\\\":\\\"ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/additional-service-ca\\\",\\\"name\\\":\\\"additional-service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/server-cert\\\",\\\"name\\\":\\\"service-proxy-server-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"cluster-proxy-proxy-agent-8459dbd967-b6s2l\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:41.771473 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.771417    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16e2a89862a2a359709d5e15ab45d48a41582b58f029f689a9703b468957426c\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"metrics-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-dns\"/\"dns-default-5b2kq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:41.812577 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.812474    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nkdv9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:41.852544 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.852487    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a2b78ebb-f09f-4caf-88d7-3c37b2276539\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:20ad3393e0e7304db066dbe287db5ab44be9032217e1e5c94406d3e3bd1fe672\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ztd8h\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-console-operator\"/\"console-operator-584dcb6b54-r4gfr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:41.866839 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.866809    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-24nvc\""
Jul 27 19:27:41.870636 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.870619    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:41.914316 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.914266    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:41.952629 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.952558    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16e2a89862a2a359709d5e15ab45d48a41582b58f029f689a9703b468957426c\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"metrics-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-dns\"/\"dns-default-5b2kq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:41.980728 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:41.980694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:41.980869 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.980833    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:27:41.980926 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.980914    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert podName:03221ef7-ec98-4d51-8ed9-9564a1ae597b nodeName:}" failed. No retries permitted until 2026-07-27 19:27:42.980895847 +0000 UTC m=+122.676451940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tgfb5" (UID: "03221ef7-ec98-4d51-8ed9-9564a1ae597b") : secret "networking-console-plugin-cert" not found
Jul 27 19:27:41.991772 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:41.991730    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-297pb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-8c56f\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:42.031279 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.031222    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22a20fce18eff6a339d1ccd64f4f1be550af86ecf079f3c9d9ee476e650ba013\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-monitoring-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"cluster-monitoring-operator-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cluster-monitoring-operator/telemetry\\\",\\\"name\\\":\\\"telemetry-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-zlxrl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-monitoring\"/\"cluster-monitoring-operator-548b489cb8-mmxrs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:42.071134 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.071050    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a8a7150-5c04-48c1-be16-9ea34bc9d937\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:38be0cf7145e21615b72b12be031fd2071873afe8d11ac5b734b10e1e66fb357\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"volume-data-source-validator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2q299\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-storage-operator\"/\"volume-data-source-validator-549c6d54cf-v22x8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:42.117423 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.117278    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:42.152485 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.152415    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"12fd86af-c063-43cb-85e1-e217480dca40\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/managed/hub-kubeconfig\\\",\\\"name\\\":\\\"hub-kubeconfig\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8cmf6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"managed-serviceaccount-addon-agent-7c667796f8-6txwr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:42.181945 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:42.181910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:42.182085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:42.182008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:42.182085 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.182067    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:27:42.182085 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.182083    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55b4bd5d48-h6mvq: secret "image-registry-tls" not found
Jul 27 19:27:42.182228 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.182134    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls podName:133b853f-ec18-4f5a-91b0-503c10284cc9 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.182121692 +0000 UTC m=+123.877677777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls") pod "image-registry-55b4bd5d48-h6mvq" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9") : secret "image-registry-tls" not found
Jul 27 19:27:42.182228 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.182163    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:27:42.182308 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.182230    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls podName:f25992a9-9aaa-4bd9-aa0e-83c123afc97c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.18221201 +0000 UTC m=+123.877768097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls") pod "dns-default-5b2kq" (UID: "f25992a9-9aaa-4bd9-aa0e-83c123afc97c") : secret "dns-default-metrics-tls" not found
Jul 27 19:27:42.194120 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.194068    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a954648-6bb0-4672-817b-bfcb20c925db\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"router\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/private\\\",\\\"name\\\":\\\"default-certificate\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/haproxy/conf/metrics-auth\\\",\\\"name\\\":\\\"stats-auth\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rzgzj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress\"/\"router-default-648c8c87b9-rl85h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:42.233955 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.233899    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:42.271475 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.271425    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f18b87cf-93b3-4ba6-8260-2efcfee5be08\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"serve-healthcheck-canary\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls-cert\\\",\\\"name\\\":\\\"cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mznc8\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress-canary\"/\"ingress-canary-c8ldc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:42.313432 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.313357    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"da1a0f98-21f8-4874-9c69-804469078a0a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"proxy-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ca\\\",\\\"name\\\":\\\"ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/additional-service-ca\\\",\\\"name\\\":\\\"additional-service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/server-cert\\\",\\\"name\\\":\\\"service-proxy-server-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"cluster-proxy-proxy-agent-8459dbd967-b6s2l\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:42.351566 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.351474    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"597d0836-1571-439a-a7d6-2d4700cfadfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-sdcrz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-7d88cb55d8-v664j\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:42.391238 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.391178    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03221ef7-ec98-4d51-8ed9-9564a1ae597b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:41Z\\\"}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-74c9f884b7-tgfb5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:42.433463 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.433409    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fec2ae87-daa0-4829-9868-36e75c205276\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"acm-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/run/klusterlet\\\",\\\"name\\\":\\\"klusterlet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-69x9w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"klusterlet-addon-workmgr-b4f56bbb-v5cp8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:42.471653 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.471596    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"501c4043-9669-4f01-bb1b-8ffdd7498bfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"samples-operator-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator-watch\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-samples-operator\"/\"cluster-samples-operator-6748489656-8xvd2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:42.485168 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:42.485141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:42.485317 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:42.485187    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:42.485317 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.485273    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:42.485431 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.485314    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.485293451 +0000 UTC m=+124.180849522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : configmap references non-existent config key: service-ca.crt
Jul 27 19:27:42.485431 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.485340    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls podName:36a1b7d0-2ff0-499f-a375-5eca85ae7b3c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.485330823 +0000 UTC m=+124.180886898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mmxrs" (UID: "36a1b7d0-2ff0-499f-a375-5eca85ae7b3c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:42.485431 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:42.485387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:42.485589 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.485470    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:27:42.485589 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:42.485486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:42.485589 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.485521    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls podName:501c4043-9669-4f01-bb1b-8ffdd7498bfa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.48551005 +0000 UTC m=+124.181066122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls") pod "cluster-samples-operator-6748489656-8xvd2" (UID: "501c4043-9669-4f01-bb1b-8ffdd7498bfa") : secret "samples-operator-tls" not found
Jul 27 19:27:42.485589 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.485574    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:27:42.485767 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.485618    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.485606386 +0000 UTC m=+124.181162460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : secret "router-metrics-certs-default" not found
Jul 27 19:27:42.511399 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.511344    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0a9cc75-3c38-4758-9674-64a5e4ef0612\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5lshv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-vcgvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:42.552008 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.551949    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"597d0836-1571-439a-a7d6-2d4700cfadfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-sdcrz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-7d88cb55d8-v664j\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:42.591099 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.591050    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03221ef7-ec98-4d51-8ed9-9564a1ae597b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:41Z\\\"}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-74c9f884b7-tgfb5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:42.631712 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.631602    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fec2ae87-daa0-4829-9868-36e75c205276\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"acm-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/run/klusterlet\\\",\\\"name\\\":\\\"klusterlet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-69x9w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"klusterlet-addon-workmgr-b4f56bbb-v5cp8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:42.673202 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.673137    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"501c4043-9669-4f01-bb1b-8ffdd7498bfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"samples-operator-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator-watch\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-samples-operator\"/\"cluster-samples-operator-6748489656-8xvd2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:42.711148 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.711085    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0a9cc75-3c38-4758-9674-64a5e4ef0612\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5lshv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-vcgvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:42.752700 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.752629    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nkdv9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:42.793194 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.793123    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a2b78ebb-f09f-4caf-88d7-3c37b2276539\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:20ad3393e0e7304db066dbe287db5ab44be9032217e1e5c94406d3e3bd1fe672\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ztd8h\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-console-operator\"/\"console-operator-584dcb6b54-r4gfr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:42.834461 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.834396    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:42.872467 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.872402    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16e2a89862a2a359709d5e15ab45d48a41582b58f029f689a9703b468957426c\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"metrics-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-dns\"/\"dns-default-5b2kq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:42.911460 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.911332    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-297pb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-8c56f\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:42.951668 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.951600    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22a20fce18eff6a339d1ccd64f4f1be550af86ecf079f3c9d9ee476e650ba013\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-monitoring-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"cluster-monitoring-operator-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cluster-monitoring-operator/telemetry\\\",\\\"name\\\":\\\"telemetry-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-zlxrl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-monitoring\"/\"cluster-monitoring-operator-548b489cb8-mmxrs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:42.989130 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:42.989103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:42.989290 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.989270    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:27:42.989363 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.989350    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert podName:03221ef7-ec98-4d51-8ed9-9564a1ae597b nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.989329652 +0000 UTC m=+124.684885742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tgfb5" (UID: "03221ef7-ec98-4d51-8ed9-9564a1ae597b") : secret "networking-console-plugin-cert" not found
Jul 27 19:27:42.991711 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:42.991664    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a8a7150-5c04-48c1-be16-9ea34bc9d937\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:38be0cf7145e21615b72b12be031fd2071873afe8d11ac5b734b10e1e66fb357\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"volume-data-source-validator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2q299\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-storage-operator\"/\"volume-data-source-validator-549c6d54cf-v22x8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:43.042466 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.042312    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:43.071376 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.071324    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"12fd86af-c063-43cb-85e1-e217480dca40\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/managed/hub-kubeconfig\\\",\\\"name\\\":\\\"hub-kubeconfig\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8cmf6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"managed-serviceaccount-addon-agent-7c667796f8-6txwr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:43.113754 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.113701    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a954648-6bb0-4672-817b-bfcb20c925db\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"router\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/private\\\",\\\"name\\\":\\\"default-certificate\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/haproxy/conf/metrics-auth\\\",\\\"name\\\":\\\"stats-auth\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rzgzj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress\"/\"router-default-648c8c87b9-rl85h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:43.153212 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.153154    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:43.191404 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.191353    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f18b87cf-93b3-4ba6-8260-2efcfee5be08\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"serve-healthcheck-canary\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls-cert\\\",\\\"name\\\":\\\"cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mznc8\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress-canary\"/\"ingress-canary-c8ldc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:43.233024 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.232953    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"da1a0f98-21f8-4874-9c69-804469078a0a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"proxy-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ca\\\",\\\"name\\\":\\\"ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/additional-service-ca\\\",\\\"name\\\":\\\"additional-service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/server-cert\\\",\\\"name\\\":\\\"service-proxy-server-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"cluster-proxy-proxy-agent-8459dbd967-b6s2l\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:43.446349 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.446216    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:43.458265 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.458182    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:43.470032 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.469948    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:43.482458 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.482382    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:43.495027 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.494933    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-131-166.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused"
Jul 27 19:27:43.495027 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:43.495019    2559 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:43.935934 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:43.935903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:43.936288 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:43.936151    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:44.153695 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.153667    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:44.153695 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4" Netns:"/var/run/netns/4569f9fa-79c4-4b46-99b9-02de3f5ef39a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:44.153695 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:44.153695 ip-10-0-131-166 kubenswrapper[2559]:  >
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.153718    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4" Netns:"/var/run/netns/4569f9fa-79c4-4b46-99b9-02de3f5ef39a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.153740    2559 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4" Netns:"/var/run/netns/4569f9fa-79c4-4b46-99b9-02de3f5ef39a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393" Path:"" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s": dial tcp 172.30.119.215:9743: connect: connection refused
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]:  > pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:44.153876 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.153813    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"global-pull-secret-syncer-x2hh9_kube-system(855ba6bc-d302-4d1d-b728-e39baf9c6393)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_global-pull-secret-syncer-x2hh9_kube-system_855ba6bc-d302-4d1d-b728-e39baf9c6393_0(f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4): error adding pod kube-system_global-pull-secret-syncer-x2hh9 to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4\\\" Netns:\\\"/var/run/netns/4569f9fa-79c4-4b46-99b9-02de3f5ef39a\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=kube-system;K8S_POD_NAME=global-pull-secret-syncer-x2hh9;K8S_POD_INFRA_CONTAINER_ID=f62f572f0a8ee60f27406ba9c8ca19629e384ff77a6b3fe93b1bec84bc346aa4;K8S_POD_UID=855ba6bc-d302-4d1d-b728-e39baf9c6393\\\" Path:\\\"\\\" ERRORED: error configuring pod [kube-system/global-pull-secret-syncer-x2hh9] networking: Multus: [kube-system/global-pull-secret-syncer-x2hh9/855ba6bc-d302-4d1d-b728-e39baf9c6393]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: SetNetworkStatus: failed to update the pod global-pull-secret-syncer-x2hh9 in out of cluster comm: status update failed for pod kube-system/global-pull-secret-syncer-x2hh9: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.119.215:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="kube-system/global-pull-secret-syncer-x2hh9" podUID="855ba6bc-d302-4d1d-b728-e39baf9c6393"
Jul 27 19:27:44.198895 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.198788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:44.199044 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.198918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:44.199044 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.198952    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:27:44.199044 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.199018    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls podName:f25992a9-9aaa-4bd9-aa0e-83c123afc97c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:48.199002293 +0000 UTC m=+127.894558365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls") pod "dns-default-5b2kq" (UID: "f25992a9-9aaa-4bd9-aa0e-83c123afc97c") : secret "dns-default-metrics-tls" not found
Jul 27 19:27:44.199044 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.199023    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:27:44.199044 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.199033    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55b4bd5d48-h6mvq: secret "image-registry-tls" not found
Jul 27 19:27:44.199208 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.199070    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls podName:133b853f-ec18-4f5a-91b0-503c10284cc9 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:48.199059373 +0000 UTC m=+127.894615468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls") pod "image-registry-55b4bd5d48-h6mvq" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9") : secret "image-registry-tls" not found
Jul 27 19:27:44.349906 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.349869    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-qmgd5"]
Jul 27 19:27:44.352520 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.352504    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.354960 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.354940    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-sysctl-allowlist\""
Jul 27 19:27:44.364573 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.364530    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a8a7150-5c04-48c1-be16-9ea34bc9d937\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:38be0cf7145e21615b72b12be031fd2071873afe8d11ac5b734b10e1e66fb357\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"volume-data-source-validator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2q299\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-storage-operator\"/\"volume-data-source-validator-549c6d54cf-v22x8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:44.394190 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.394041    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:44.403455 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.403408    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"12fd86af-c063-43cb-85e1-e217480dca40\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/managed/hub-kubeconfig\\\",\\\"name\\\":\\\"hub-kubeconfig\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8cmf6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"managed-serviceaccount-addon-agent-7c667796f8-6txwr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:44.428325 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.428273    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a954648-6bb0-4672-817b-bfcb20c925db\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"router\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/private\\\",\\\"name\\\":\\\"default-certificate\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/haproxy/conf/metrics-auth\\\",\\\"name\\\":\\\"stats-auth\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rzgzj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress\"/\"router-default-648c8c87b9-rl85h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:44.441780 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.441731    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:44.455230 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.455149    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f18b87cf-93b3-4ba6-8260-2efcfee5be08\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"serve-healthcheck-canary\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls-cert\\\",\\\"name\\\":\\\"cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mznc8\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress-canary\"/\"ingress-canary-c8ldc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:44.467401 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.467341    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"da1a0f98-21f8-4874-9c69-804469078a0a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"proxy-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ca\\\",\\\"name\\\":\\\"ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/additional-service-ca\\\",\\\"name\\\":\\\"additional-service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/server-cert\\\",\\\"name\\\":\\\"service-proxy-server-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"cluster-proxy-proxy-agent-8459dbd967-b6s2l\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:44.476276 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.476235    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"597d0836-1571-439a-a7d6-2d4700cfadfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-sdcrz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-7d88cb55d8-v664j\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:44.485842 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.485801    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03221ef7-ec98-4d51-8ed9-9564a1ae597b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:41Z\\\"}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-74c9f884b7-tgfb5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:44.496378 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.496333    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fec2ae87-daa0-4829-9868-36e75c205276\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"acm-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/run/klusterlet\\\",\\\"name\\\":\\\"klusterlet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-69x9w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"klusterlet-addon-workmgr-b4f56bbb-v5cp8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:44.501893 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.501868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:44.501988 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.501916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:44.501988 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.501949    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.501988 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.501971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dx7r\" (UniqueName: \"kubernetes.io/projected/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-kube-api-access-6dx7r\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.502130 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.501991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-ready\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.502130 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.502010    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:44.502130 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.502013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:44.502130 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.502072    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls podName:36a1b7d0-2ff0-499f-a375-5eca85ae7b3c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:48.50205278 +0000 UTC m=+128.197608865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mmxrs" (UID: "36a1b7d0-2ff0-499f-a375-5eca85ae7b3c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:44.502130 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.502078    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:27:44.502130 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.502079    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:27:44.502130 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.502121    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:48.502104927 +0000 UTC m=+128.197660999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : secret "router-metrics-certs-default" not found
Jul 27 19:27:44.502350 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.502138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.502350 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.502155    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls podName:501c4043-9669-4f01-bb1b-8ffdd7498bfa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:48.502142952 +0000 UTC m=+128.197699052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls") pod "cluster-samples-operator-6748489656-8xvd2" (UID: "501c4043-9669-4f01-bb1b-8ffdd7498bfa") : secret "samples-operator-tls" not found
Jul 27 19:27:44.502350 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.502202    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:44.502350 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.502278    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:48.502271841 +0000 UTC m=+128.197827916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : configmap references non-existent config key: service-ca.crt
Jul 27 19:27:44.516772 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.516719    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"501c4043-9669-4f01-bb1b-8ffdd7498bfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"samples-operator-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator-watch\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-samples-operator\"/\"cluster-samples-operator-6748489656-8xvd2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:44.528477 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.528428    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0a9cc75-3c38-4758-9674-64a5e4ef0612\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5lshv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-vcgvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:44.537584 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.537544    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nkdv9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:44.551558 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.551480    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a2b78ebb-f09f-4caf-88d7-3c37b2276539\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:20ad3393e0e7304db066dbe287db5ab44be9032217e1e5c94406d3e3bd1fe672\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ztd8h\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-console-operator\"/\"console-operator-584dcb6b54-r4gfr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:44.569359 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.569306    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:44.579730 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.579674    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16e2a89862a2a359709d5e15ab45d48a41582b58f029f689a9703b468957426c\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"metrics-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-dns\"/\"dns-default-5b2kq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:44.590072 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.590020    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-297pb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-8c56f\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:44.603111 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.603086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.603245 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.603130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dx7r\" (UniqueName: \"kubernetes.io/projected/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-kube-api-access-6dx7r\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.603245 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.603226    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.603358 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.603241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-ready\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.603358 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.603325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.603632 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.603613    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-ready\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.603847 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.603831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.608241 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.608194    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22a20fce18eff6a339d1ccd64f4f1be550af86ecf079f3c9d9ee476e650ba013\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-monitoring-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"cluster-monitoring-operator-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cluster-monitoring-operator/telemetry\\\",\\\"name\\\":\\\"telemetry-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-zlxrl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-monitoring\"/\"cluster-monitoring-operator-548b489cb8-mmxrs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:44.611651 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.611620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dx7r\" (UniqueName: \"kubernetes.io/projected/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-kube-api-access-6dx7r\") pod \"cni-sysctl-allowlist-ds-qmgd5\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") " pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.619154 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:44.619108    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/ready\\\",\\\"name\\\":\\\"ready\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6dx7r\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"podIP\\\":\\\"10.0.131.166\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"startTime\\\":\\\"2026-07-27T19:27:44Z\\\"}}\" for pod \"openshift-multus\"/\"cni-sysctl-allowlist-ds-qmgd5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.660550 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:44.660522    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:44.669577 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:44.669547    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9488fd_ab9f_4867_8d6f_b67f475b3da7.slice/crio-6cc666dffafd43fe80800d223924f9b41549577c2f63e2b6862f69bf60b1a715 WatchSource:0}: Error finding container 6cc666dffafd43fe80800d223924f9b41549577c2f63e2b6862f69bf60b1a715: Status 404 returned error can't find the container with id 6cc666dffafd43fe80800d223924f9b41549577c2f63e2b6862f69bf60b1a715
Jul 27 19:27:45.006564 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:45.006464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:45.006923 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.006607    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:27:45.006923 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.006681    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert podName:03221ef7-ec98-4d51-8ed9-9564a1ae597b nodeName:}" failed. No retries permitted until 2026-07-27 19:27:49.006665508 +0000 UTC m=+128.702221583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tgfb5" (UID: "03221ef7-ec98-4d51-8ed9-9564a1ae597b") : secret "networking-console-plugin-cert" not found
Jul 27 19:27:45.377315 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:45.377233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" event={"ID":"3c9488fd-ab9f-4867-8d6f-b67f475b3da7","Type":"ContainerStarted","Data":"68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6"}
Jul 27 19:27:45.377315 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:45.377283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" event={"ID":"3c9488fd-ab9f-4867-8d6f-b67f475b3da7","Type":"ContainerStarted","Data":"6cc666dffafd43fe80800d223924f9b41549577c2f63e2b6862f69bf60b1a715"}
Jul 27 19:27:45.377523 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:45.377502    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:45.386425 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:45.386403    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:45.388675 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.388628    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16e2a89862a2a359709d5e15ab45d48a41582b58f029f689a9703b468957426c\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"metrics-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-dns\"/\"dns-default-5b2kq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:45.397938 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.397896    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-297pb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-8c56f\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:45.407696 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.407655    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22a20fce18eff6a339d1ccd64f4f1be550af86ecf079f3c9d9ee476e650ba013\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-monitoring-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"cluster-monitoring-operator-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cluster-monitoring-operator/telemetry\\\",\\\"name\\\":\\\"telemetry-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-zlxrl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-monitoring\"/\"cluster-monitoring-operator-548b489cb8-mmxrs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:45.416654 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.416609    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:45Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:44Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/ready\\\",\\\"name\\\":\\\"ready\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6dx7r\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.0.131.166\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"startTime\\\":\\\"2026-07-27T19:27:44Z\\\"}}\" for pod \"openshift-multus\"/\"cni-sysctl-allowlist-ds-qmgd5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:45.424900 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.424842    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a8a7150-5c04-48c1-be16-9ea34bc9d937\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:38be0cf7145e21615b72b12be031fd2071873afe8d11ac5b734b10e1e66fb357\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"volume-data-source-validator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2q299\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-storage-operator\"/\"volume-data-source-validator-549c6d54cf-v22x8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:45.443402 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.443254    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:45.452122 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.452076    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"12fd86af-c063-43cb-85e1-e217480dca40\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/managed/hub-kubeconfig\\\",\\\"name\\\":\\\"hub-kubeconfig\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8cmf6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"managed-serviceaccount-addon-agent-7c667796f8-6txwr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:45.462508 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.462458    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a954648-6bb0-4672-817b-bfcb20c925db\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"router\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/private\\\",\\\"name\\\":\\\"default-certificate\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/haproxy/conf/metrics-auth\\\",\\\"name\\\":\\\"stats-auth\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rzgzj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress\"/\"router-default-648c8c87b9-rl85h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:45.474052 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.474005    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:45.482697 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.482655    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f18b87cf-93b3-4ba6-8260-2efcfee5be08\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"serve-healthcheck-canary\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls-cert\\\",\\\"name\\\":\\\"cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mznc8\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress-canary\"/\"ingress-canary-c8ldc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:45.492769 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.492710    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"da1a0f98-21f8-4874-9c69-804469078a0a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"proxy-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ca\\\",\\\"name\\\":\\\"ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/additional-service-ca\\\",\\\"name\\\":\\\"additional-service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/server-cert\\\",\\\"name\\\":\\\"service-proxy-server-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"cluster-proxy-proxy-agent-8459dbd967-b6s2l\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:45.501064 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.501020    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"597d0836-1571-439a-a7d6-2d4700cfadfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-sdcrz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-7d88cb55d8-v664j\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:45.509063 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.509020    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03221ef7-ec98-4d51-8ed9-9564a1ae597b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:41Z\\\"}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-74c9f884b7-tgfb5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:45.518102 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.518060    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fec2ae87-daa0-4829-9868-36e75c205276\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"acm-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/run/klusterlet\\\",\\\"name\\\":\\\"klusterlet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-69x9w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"klusterlet-addon-workmgr-b4f56bbb-v5cp8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:45.527354 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.527307    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"501c4043-9669-4f01-bb1b-8ffdd7498bfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"samples-operator-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator-watch\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-samples-operator\"/\"cluster-samples-operator-6748489656-8xvd2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:45.537182 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.537135    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0a9cc75-3c38-4758-9674-64a5e4ef0612\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5lshv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-vcgvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:45.545728 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.545689    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nkdv9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:45.557527 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.557486    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a2b78ebb-f09f-4caf-88d7-3c37b2276539\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:20ad3393e0e7304db066dbe287db5ab44be9032217e1e5c94406d3e3bd1fe672\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ztd8h\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-console-operator\"/\"console-operator-584dcb6b54-r4gfr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:45.570614 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.570575    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:45.578937 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.578897    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0a8a7150-5c04-48c1-be16-9ea34bc9d937\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [volume-data-source-validator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:38be0cf7145e21615b72b12be031fd2071873afe8d11ac5b734b10e1e66fb357\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"volume-data-source-validator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2q299\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-storage-operator\"/\"volume-data-source-validator-549c6d54cf-v22x8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"
Jul 27 19:27:45.595629 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.595492    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab06e64b-b71c-47e2-b5e9-85941805ae44\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:41Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://7b80c4f463cdcfce90cfd5753e6c7619327b996f19959733be0ef1fe96ed3622\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://08467f10c4c982a47bf1266a3c4c520f05efcfc12db88da5a498eaf89c3c5e9b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://5979ecb5271e9b768eb845792758d2bb75077f8119c8ce70d207352f4861f4cd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://9211b7ffec81c0e73ad4c47b6cdc13a181b0e145a3a5c06fa4799316c9b99979\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:03Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://8ccbe7a497776488931bc99d72a78cbf23f739fa3ac356a94ca94f6ac964f490\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://644aebffe5e52558ca310b1b29c24104a19a89968e75e83d40bf92bad7a87364\\\",\\\"exitCode\\\":1,\\\"finishedAt\\\":\\\"2026-07-27T19:26:02Z\\\",\\\"message\\\":\\\"++ K8S_NODE=\\\\n++ [[ -n '' ]]\\\\n++ northd_pidfile=/var/run/ovn/ovn-northd.pid\\\\n++ controller_pidfile=/var/run/ovn/ovn-controller.pid\\\\n++ controller_logfile=/var/log/ovn/acl-audit-log.log\\\\n++ vswitch_dbsock=/var/run/openvswitch/db.sock\\\\n++ nbdb_pidfile=/var/run/ovn/ovnnb_db.pid\\\\n++ nbdb_sock=/var/run/ovn/ovnnb_db.sock\\\\n++ nbdb_ctl=/var/run/ovn/ovnnb_db.ctl\\\\n++ sbdb_pidfile=/var/run/ovn/ovnsb_db.pid\\\\n++ sbdb_sock=/var/run/ovn/ovnsb_db.sock\\\\n++ sbdb_ctl=/var/run/ovn/ovnsb_db.ctl\\\\n+ start-audit-log-rotation\\\\n+ [[ '' != \\\\\\\\t\\\\\\\\r\\\\\\\\u\\\\\\\\e ]]\\\\n+ set +x\\\\ncat: /var/run/ovn/ovn-controller.pid: No such file or directory\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:08Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://1f1a59eaefc4e77e00a96cc1a13cab046dd04f1041cc4b5cf4ec8ce629349f33\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:02Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://4c2d927959e7636eb2f67ca14c894bc1f372dc8b0391b390d8490c4cb15e357a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://aab4c49538e3b46a9f6180cce991736e369283bac4a8c6e94bbd42d4e53a9c24\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-s25sf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-qjf8q\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-qjf8q"
Jul 27 19:27:45.604031 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.603995    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"12fd86af-c063-43cb-85e1-e217480dca40\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [addon-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/managed/hub-kubeconfig\\\",\\\"name\\\":\\\"hub-kubeconfig\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8cmf6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"managed-serviceaccount-addon-agent-7c667796f8-6txwr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"
Jul 27 19:27:45.623706 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.623661    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a954648-6bb0-4672-817b-bfcb20c925db\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [router]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"router\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/private\\\",\\\"name\\\":\\\"default-certificate\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/haproxy/conf/metrics-auth\\\",\\\"name\\\":\\\"stats-auth\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-rzgzj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress\"/\"router-default-648c8c87b9-rl85h\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:45.636551 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.636480    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"133b853f-ec18-4f5a-91b0-503c10284cc9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [registry]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"registry\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/cloud\\\",\\\"name\\\":\\\"image-registry-private-configuration\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"registry-tls\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted\\\",\\\"name\\\":\\\"ca-trust-extracted\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/source/anchors\\\",\\\"name\\\":\\\"registry-certificates\\\"},{\\\"mountPath\\\":\\\"/usr/share/pki/ca-trust-source\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet/\\\",\\\"name\\\":\\\"installation-pull-secrets\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/openshift/serviceaccount\\\",\\\"name\\\":\\\"bound-sa-token\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6wgq9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-image-registry\"/\"image-registry-55b4bd5d48-h6mvq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:45.646748 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.646706    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f18b87cf-93b3-4ba6-8260-2efcfee5be08\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [serve-healthcheck-canary]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"serve-healthcheck-canary\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls-cert\\\",\\\"name\\\":\\\"cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mznc8\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-ingress-canary\"/\"ingress-canary-c8ldc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ingress-canary/ingress-canary-c8ldc"
Jul 27 19:27:45.657049 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.656990    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"da1a0f98-21f8-4874-9c69-804469078a0a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [proxy-agent addon-agent service-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"addon-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"proxy-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ca\\\",\\\"name\\\":\\\"ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/cluster-proxy-rhel9@sha256:49efbdb69a463553cc6db3b0064f8ac28144a2557bb7081b6b56e9ea9e4b67d8\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubeconfig/\\\",\\\"name\\\":\\\"hub-kubeconfig\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls\\\",\\\"name\\\":\\\"hub\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/additional-service-ca\\\",\\\"name\\\":\\\"additional-service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/server-cert\\\",\\\"name\\\":\\\"service-proxy-server-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nv94j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"cluster-proxy-proxy-agent-8459dbd967-b6s2l\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:27:45.665656 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.665614    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"597d0836-1571-439a-a7d6-2d4700cfadfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-sdcrz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-7d88cb55d8-v664j\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"
Jul 27 19:27:45.675175 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.675133    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03221ef7-ec98-4d51-8ed9-9564a1ae597b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:41Z\\\"}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-74c9f884b7-tgfb5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:45.685067 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.685026    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fec2ae87-daa0-4829-9868-36e75c205276\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [acm-agent]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"acm-agent\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/run/klusterlet\\\",\\\"name\\\":\\\"klusterlet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-69x9w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"open-cluster-management-agent-addon\"/\"klusterlet-addon-workmgr-b4f56bbb-v5cp8\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:27:45.695301 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.695249    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"501c4043-9669-4f01-bb1b-8ffdd7498bfa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-samples-operator cluster-samples-operator-watch]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/secrets\\\",\\\"name\\\":\\\"samples-operator-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca41189832d5c7e7b5399a4bdefc28be186945c77c50c799067c073e38d12481\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-samples-operator-watch\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mrfm2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-cluster-samples-operator\"/\"cluster-samples-operator-6748489656-8xvd2\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:45.704831 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.704779    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0a9cc75-3c38-4758-9674-64a5e4ef0612\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5lshv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-vcgvv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-vcgvv"
Jul 27 19:27:45.713633 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.713591    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-storage-version-migrator-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87219d6bd84a6e870cf4ff738ca32f5424e2189581de3e20983936fc728afaf9\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-storage-version-migrator-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-nkdv9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"
Jul 27 19:27:45.723072 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.723025    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a2b78ebb-f09f-4caf-88d7-3c37b2276539\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [console-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:20ad3393e0e7304db066dbe287db5ab44be9032217e1e5c94406d3e3bd1fe672\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"trusted-ca\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ztd8h\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-console-operator\"/\"console-operator-584dcb6b54-r4gfr\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:27:45.742057 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.742013    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445d35f0-1473-4e0d-b15a-f867170652e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://ad1c20ee8eb43002a93c4399fa7313c54a68cb1433628908dea1feba10117f5a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-wnpcv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-ghclq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-ghclq"
Jul 27 19:27:45.752766 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.752717    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [dns kube-rbac-proxy]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16e2a89862a2a359709d5e15ab45d48a41582b58f029f689a9703b468957426c\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/coredns\\\",\\\"name\\\":\\\"config-volume\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"metrics-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-5x97w\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-dns\"/\"dns-default-5b2kq\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:45.762158 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.762118    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [service-ca-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"service-ca-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/configmaps/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-297pb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-service-ca-operator\"/\"service-ca-operator-5d6c75f84f-8c56f\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"
Jul 27 19:27:45.773331 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.773287    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:40Z\\\",\\\"message\\\":\\\"containers with unready status: [cluster-monitoring-operator]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22a20fce18eff6a339d1ccd64f4f1be550af86ecf079f3c9d9ee476e650ba013\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-monitoring-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"cluster-monitoring-operator-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cluster-monitoring-operator/telemetry\\\",\\\"name\\\":\\\"telemetry-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-zlxrl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-27T19:27:40Z\\\"}}\" for pod \"openshift-monitoring\"/\"cluster-monitoring-operator-548b489cb8-mmxrs\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:45.787863 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:45.787811    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:45Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:44Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:45Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:45Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:44Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/ready\\\",\\\"name\\\":\\\"ready\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-6dx7r\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.131.166\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"observedGeneration\\\":1,\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.0.131.166\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.0.131.166\\\"}],\\\"startTime\\\":\\\"2026-07-27T19:27:44Z\\\"}}\" for pod \"openshift-multus\"/\"cni-sysctl-allowlist-ds-qmgd5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:27:48.233336 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:48.233296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:48.233776 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:48.233477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:48.233776 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.233480    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:27:48.233776 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.233598    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55b4bd5d48-h6mvq: secret "image-registry-tls" not found
Jul 27 19:27:48.233776 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.233656    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls podName:133b853f-ec18-4f5a-91b0-503c10284cc9 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:56.233641713 +0000 UTC m=+135.929197785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls") pod "image-registry-55b4bd5d48-h6mvq" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9") : secret "image-registry-tls" not found
Jul 27 19:27:48.233776 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.233540    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:27:48.233776 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.233749    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls podName:f25992a9-9aaa-4bd9-aa0e-83c123afc97c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:56.233736581 +0000 UTC m=+135.929292653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls") pod "dns-default-5b2kq" (UID: "f25992a9-9aaa-4bd9-aa0e-83c123afc97c") : secret "dns-default-metrics-tls" not found
Jul 27 19:27:48.536421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:48.536329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:48.536421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:48.536391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:48.536620 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:48.536447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:48.536620 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.536484    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:48.536620 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:48.536503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:48.536620 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.536553    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls podName:36a1b7d0-2ff0-499f-a375-5eca85ae7b3c nodeName:}" failed. No retries permitted until 2026-07-27 19:27:56.536538137 +0000 UTC m=+136.232094212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mmxrs" (UID: "36a1b7d0-2ff0-499f-a375-5eca85ae7b3c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:48.536620 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.536556    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:27:48.536620 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.536605    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:27:48.536798 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.536627    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:56.536611778 +0000 UTC m=+136.232167853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : configmap references non-existent config key: service-ca.crt
Jul 27 19:27:48.536798 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.536646    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:27:56.536635222 +0000 UTC m=+136.232191323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : secret "router-metrics-certs-default" not found
Jul 27 19:27:48.536798 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:48.536660    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls podName:501c4043-9669-4f01-bb1b-8ffdd7498bfa nodeName:}" failed. No retries permitted until 2026-07-27 19:27:56.536652693 +0000 UTC m=+136.232208770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls") pod "cluster-samples-operator-6748489656-8xvd2" (UID: "501c4043-9669-4f01-bb1b-8ffdd7498bfa") : secret "samples-operator-tls" not found
Jul 27 19:27:49.040926 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:49.040890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:49.041101 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:49.041037    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:27:49.041143 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:49.041116    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert podName:03221ef7-ec98-4d51-8ed9-9564a1ae597b nodeName:}" failed. No retries permitted until 2026-07-27 19:27:57.041098828 +0000 UTC m=+136.736654903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tgfb5" (UID: "03221ef7-ec98-4d51-8ed9-9564a1ae597b") : secret "networking-console-plugin-cert" not found
Jul 27 19:27:50.555706 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:50.555667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:27:50.556194 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:50.555809    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 19:27:50.556194 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:50.555885    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs podName:9225ea5e-34f0-4663-bf0e-58ac3b59f78a nodeName:}" failed. No retries permitted until 2026-07-27 19:29:52.555870954 +0000 UTC m=+252.251427029 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs") pod "network-metrics-daemon-gw4wp" (UID: "9225ea5e-34f0-4663-bf0e-58ac3b59f78a") : secret "metrics-daemon-secret" not found
Jul 27 19:27:50.961991 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:50.961961    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"]
Jul 27 19:27:51.028184 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.028153    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"]
Jul 27 19:27:51.047001 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.046933    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-648c8c87b9-rl85h"]
Jul 27 19:27:51.065751 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.065704    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55b4bd5d48-h6mvq"]
Jul 27 19:27:51.080262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.080235    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c8ldc"]
Jul 27 19:27:51.095442 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.095366    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"]
Jul 27 19:27:51.105252 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.105228    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"]
Jul 27 19:27:51.111283 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.111261    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr"]
Jul 27 19:27:51.115078 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.115053    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12fd86af_c063_43cb_85e1_e217480dca40.slice/crio-37c556f024d0e2669ceaf2f2175c8de9e0f6cb634af3700ce047c1be28ba34ed WatchSource:0}: Error finding container 37c556f024d0e2669ceaf2f2175c8de9e0f6cb634af3700ce047c1be28ba34ed: Status 404 returned error can't find the container with id 37c556f024d0e2669ceaf2f2175c8de9e0f6cb634af3700ce047c1be28ba34ed
Jul 27 19:27:51.123539 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.123099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"]
Jul 27 19:27:51.138063 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.137635    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"]
Jul 27 19:27:51.160522 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.160490    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"]
Jul 27 19:27:51.177629 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.177531    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8a7150_5c04_48c1_be16_9ea34bc9d937.slice/crio-9dbeaaba6ee48acc385f83359a17e846a84f72c723ca430eb745e8bf5e88a3a7 WatchSource:0}: Error finding container 9dbeaaba6ee48acc385f83359a17e846a84f72c723ca430eb745e8bf5e88a3a7: Status 404 returned error can't find the container with id 9dbeaaba6ee48acc385f83359a17e846a84f72c723ca430eb745e8bf5e88a3a7
Jul 27 19:27:51.186446 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.186416    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8"]
Jul 27 19:27:51.189395 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.189367    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-vcgvv"]
Jul 27 19:27:51.190338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.190315    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"]
Jul 27 19:27:51.215801 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.215732    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-r4gfr"]
Jul 27 19:27:51.222100 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.222070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j"]
Jul 27 19:27:51.225508 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.225468    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597d0836_1571_439a_a7d6_2d4700cfadfa.slice/crio-43dd39b7bcf15fa12e9f0602b691386123507942bc7319725a831515ab023251 WatchSource:0}: Error finding container 43dd39b7bcf15fa12e9f0602b691386123507942bc7319725a831515ab023251: Status 404 returned error can't find the container with id 43dd39b7bcf15fa12e9f0602b691386123507942bc7319725a831515ab023251
Jul 27 19:27:51.227927 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.227366    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ghclq" podStartSLOduration=101.233165268 podStartE2EDuration="2m10.227347751s" totalImagesPullingTime="28.994182483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:51.226819467 +0000 UTC m=+130.922375565" watchObservedRunningTime="2026-07-27 19:27:51.227347751 +0000 UTC m=+130.922903847"
Jul 27 19:27:51.263499 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.263467    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5b2kq"]
Jul 27 19:27:51.279325 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.279299    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"]
Jul 27 19:27:51.286110 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.286087    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"]
Jul 27 19:27:51.290088 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.290064    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda1a0f98_21f8_4874_9c69_804469078a0a.slice/crio-b8367ed080d84859b41086c01aaebc03fdebdb0b229b9aeab2138cfe2656a851 WatchSource:0}: Error finding container b8367ed080d84859b41086c01aaebc03fdebdb0b229b9aeab2138cfe2656a851: Status 404 returned error can't find the container with id b8367ed080d84859b41086c01aaebc03fdebdb0b229b9aeab2138cfe2656a851
Jul 27 19:27:51.300053 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.299326    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"]
Jul 27 19:27:51.300161 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.300099    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" podStartSLOduration=7.300079005 podStartE2EDuration="7.300079005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:51.299467637 +0000 UTC m=+130.995023732" watchObservedRunningTime="2026-07-27 19:27:51.300079005 +0000 UTC m=+130.995635168"
Jul 27 19:27:51.334838 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.334756    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-r4gfr"]
Jul 27 19:27:51.374996 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.374923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c8ldc"]
Jul 27 19:27:51.379667 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.379637    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf18b87cf_93b3_4ba6_8260_2efcfee5be08.slice/crio-6d9ed7a7ff44212822c798135935eea218f03b712390a6e7cf5e6b7726763626 WatchSource:0}: Error finding container 6d9ed7a7ff44212822c798135935eea218f03b712390a6e7cf5e6b7726763626: Status 404 returned error can't find the container with id 6d9ed7a7ff44212822c798135935eea218f03b712390a6e7cf5e6b7726763626
Jul 27 19:27:51.391980 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.391949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c8ldc" event={"ID":"f18b87cf-93b3-4ba6-8260-2efcfee5be08","Type":"ContainerStarted","Data":"6d9ed7a7ff44212822c798135935eea218f03b712390a6e7cf5e6b7726763626"}
Jul 27 19:27:51.393280 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.393242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j" event={"ID":"597d0836-1571-439a-a7d6-2d4700cfadfa","Type":"ContainerStarted","Data":"43dd39b7bcf15fa12e9f0602b691386123507942bc7319725a831515ab023251"}
Jul 27 19:27:51.394681 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.394656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8" event={"ID":"0a8a7150-5c04-48c1-be16-9ea34bc9d937","Type":"ContainerStarted","Data":"9dbeaaba6ee48acc385f83359a17e846a84f72c723ca430eb745e8bf5e88a3a7"}
Jul 27 19:27:51.396363 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.396298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" event={"ID":"a2b78ebb-f09f-4caf-88d7-3c37b2276539","Type":"ContainerStarted","Data":"43c3d1e23d093026ed520f29ef413e77ebd50625171314b8fbdd0d38f73651d8"}
Jul 27 19:27:51.397693 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.397646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr" event={"ID":"12fd86af-c063-43cb-85e1-e217480dca40","Type":"ContainerStarted","Data":"37c556f024d0e2669ceaf2f2175c8de9e0f6cb634af3700ce047c1be28ba34ed"}
Jul 27 19:27:51.398831 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.398787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" event={"ID":"da1a0f98-21f8-4874-9c69-804469078a0a","Type":"ContainerStarted","Data":"b8367ed080d84859b41086c01aaebc03fdebdb0b229b9aeab2138cfe2656a851"}
Jul 27 19:27:51.399524 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.399507    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-qmgd5"]
Jul 27 19:27:51.400068 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.399814    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerName="kube-multus-additional-cni-plugins" containerID="cri-o://68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" gracePeriod=30
Jul 27 19:27:51.424704 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.422605    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-vcgvv"]
Jul 27 19:27:51.426235 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.426209    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a9cc75_3c38_4758_9674_64a5e4ef0612.slice/crio-86ff844301fbf34ff9cb70acb9942f031da1490e1f635825df4af5ab0cb1b2e8 WatchSource:0}: Error finding container 86ff844301fbf34ff9cb70acb9942f031da1490e1f635825df4af5ab0cb1b2e8: Status 404 returned error can't find the container with id 86ff844301fbf34ff9cb70acb9942f031da1490e1f635825df4af5ab0cb1b2e8
Jul 27 19:27:51.439688 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.439412    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"]
Jul 27 19:27:51.444192 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.444165    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec2ae87_daa0_4829_9868_36e75c205276.slice/crio-7206d5f6d6bc8d44182399be887bcdc019bf43859d9def099e5d52abc70bb2c7 WatchSource:0}: Error finding container 7206d5f6d6bc8d44182399be887bcdc019bf43859d9def099e5d52abc70bb2c7: Status 404 returned error can't find the container with id 7206d5f6d6bc8d44182399be887bcdc019bf43859d9def099e5d52abc70bb2c7
Jul 27 19:27:51.452146 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.452078    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26"]
Jul 27 19:27:51.456597 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.456574    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9094e27_933d_4f5e_ba44_6ddc0d76a6f4.slice/crio-222af5849ba33c8952786b6887b0afee69ea45160fd68d1f4100bac60e868f36 WatchSource:0}: Error finding container 222af5849ba33c8952786b6887b0afee69ea45160fd68d1f4100bac60e868f36: Status 404 returned error can't find the container with id 222af5849ba33c8952786b6887b0afee69ea45160fd68d1f4100bac60e868f36
Jul 27 19:27:51.560176 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:51.560099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f"]
Jul 27 19:27:51.563363 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:27:51.563328    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod613f0bd9_0f9f_4a89_87e8_b9e2db5be64a.slice/crio-615cffedca4b978f7c3e32b752fa2fefe4e559cd8c334bbe559d073e43fc7449 WatchSource:0}: Error finding container 615cffedca4b978f7c3e32b752fa2fefe4e559cd8c334bbe559d073e43fc7449: Status 404 returned error can't find the container with id 615cffedca4b978f7c3e32b752fa2fefe4e559cd8c334bbe559d073e43fc7449
Jul 27 19:27:52.410510 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:52.410400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26" event={"ID":"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4","Type":"ContainerStarted","Data":"222af5849ba33c8952786b6887b0afee69ea45160fd68d1f4100bac60e868f36"}
Jul 27 19:27:52.421251 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:52.421213    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f" event={"ID":"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a","Type":"ContainerStarted","Data":"615cffedca4b978f7c3e32b752fa2fefe4e559cd8c334bbe559d073e43fc7449"}
Jul 27 19:27:52.433045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:52.433008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8" event={"ID":"fec2ae87-daa0-4829-9868-36e75c205276","Type":"ContainerStarted","Data":"7206d5f6d6bc8d44182399be887bcdc019bf43859d9def099e5d52abc70bb2c7"}
Jul 27 19:27:52.441914 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:52.441804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-vcgvv" event={"ID":"d0a9cc75-3c38-4758-9674-64a5e4ef0612","Type":"ContainerStarted","Data":"86ff844301fbf34ff9cb70acb9942f031da1490e1f635825df4af5ab0cb1b2e8"}
Jul 27 19:27:53.936011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:53.935980    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:53.936468 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:53.936243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:27:54.486085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:54.486047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8" event={"ID":"0a8a7150-5c04-48c1-be16-9ea34bc9d937","Type":"ContainerStarted","Data":"3f7f544024043e3b5905b3d7d5f983b92aafcf243dbcaa684942fb742f63dc26"}
Jul 27 19:27:54.504306 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:54.504245    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v22x8" podStartSLOduration=12.316175251 podStartE2EDuration="14.504223387s" totalImagesPullingTime="2.188048136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:54.503739678 +0000 UTC m=+134.199295776" watchObservedRunningTime="2026-07-27 19:27:54.504223387 +0000 UTC m=+134.199779482"
Jul 27 19:27:55.382421 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:55.382348    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:27:55.383589 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:55.383480    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:27:55.390254 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:55.389911    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:27:55.390254 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:55.389960    2559 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerName="kube-multus-additional-cni-plugins" probeResult="unknown"
Jul 27 19:27:56.320782 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:56.320734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:27:56.320970 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:56.320912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:27:56.321050 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.320997    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:27:56.321110 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.321085    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls podName:f25992a9-9aaa-4bd9-aa0e-83c123afc97c nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.321063431 +0000 UTC m=+152.016619526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls") pod "dns-default-5b2kq" (UID: "f25992a9-9aaa-4bd9-aa0e-83c123afc97c") : secret "dns-default-metrics-tls" not found
Jul 27 19:27:56.321175 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.321091    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:27:56.321175 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.321126    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55b4bd5d48-h6mvq: secret "image-registry-tls" not found
Jul 27 19:27:56.321260 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.321178    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls podName:133b853f-ec18-4f5a-91b0-503c10284cc9 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.321160073 +0000 UTC m=+152.016716153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls") pod "image-registry-55b4bd5d48-h6mvq" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9") : secret "image-registry-tls" not found
Jul 27 19:27:56.624431 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:56.624338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:56.624432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:56.624486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.624505    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:56.624543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.624588    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.624566646 +0000 UTC m=+152.320122738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : secret "router-metrics-certs-default" not found
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.624654    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.624703    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls podName:501c4043-9669-4f01-bb1b-8ffdd7498bfa nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.6246874 +0000 UTC m=+152.320243478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls") pod "cluster-samples-operator-6748489656-8xvd2" (UID: "501c4043-9669-4f01-bb1b-8ffdd7498bfa") : secret "samples-operator-tls" not found
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.624760    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.624814    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls podName:36a1b7d0-2ff0-499f-a375-5eca85ae7b3c nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.624798414 +0000 UTC m=+152.320354500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mmxrs" (UID: "36a1b7d0-2ff0-499f-a375-5eca85ae7b3c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:27:56.624895 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:56.624834    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.624824003 +0000 UTC m=+152.320380078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : configmap references non-existent config key: service-ca.crt
Jul 27 19:27:57.129325 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:57.129286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:27:57.129497 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:57.129472    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:27:57.129569 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:27:57.129558    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert podName:03221ef7-ec98-4d51-8ed9-9564a1ae597b nodeName:}" failed. No retries permitted until 2026-07-27 19:28:13.1295365 +0000 UTC m=+152.825092594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tgfb5" (UID: "03221ef7-ec98-4d51-8ed9-9564a1ae597b") : secret "networking-console-plugin-cert" not found
Jul 27 19:27:57.936266 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:57.936229    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:27:57.936723 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:27:57.936528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2hh9"
Jul 27 19:28:02.402913 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.398458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fr7pm"]
Jul 27 19:28:02.432730 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.432427    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2hh9"]
Jul 27 19:28:02.527196 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.526345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr" event={"ID":"12fd86af-c063-43cb-85e1-e217480dca40","Type":"ContainerStarted","Data":"203c06adb41d4916e8dfff369b3569bab321dd461280a180e0acdce6f0121263"}
Jul 27 19:28:02.529466 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.529435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26" event={"ID":"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4","Type":"ContainerStarted","Data":"6895c15c43c11ccdf392e6372d818d6961f829710fec5e8361d051f75479b510"}
Jul 27 19:28:02.533472 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.533447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f" event={"ID":"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a","Type":"ContainerStarted","Data":"2df50dc257c250f747db608eb9896371ade8262da0af2986065b02d5b3fccdce"}
Jul 27 19:28:02.538407 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.538383    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" event={"ID":"da1a0f98-21f8-4874-9c69-804469078a0a","Type":"ContainerStarted","Data":"0e06a94a4f56fae059d6d6a3e0f2f6c4f8b2894616426f6e8657ca005dd743ad"}
Jul 27 19:28:02.539711 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.539691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2hh9" event={"ID":"855ba6bc-d302-4d1d-b728-e39baf9c6393","Type":"ContainerStarted","Data":"c6cebd497f78a2518d6272764c49bae4a6c8c617833ce82a08e8ae0d1c311cd4"}
Jul 27 19:28:02.541480 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.541436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c8ldc" event={"ID":"f18b87cf-93b3-4ba6-8260-2efcfee5be08","Type":"ContainerStarted","Data":"dc3eab50cf4e15904ec513824d47349fc1b7b68795c0ce7e31e03c5361a09183"}
Jul 27 19:28:02.542242 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.542120    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c667796f8-6txwr" podStartSLOduration=11.465713481 podStartE2EDuration="22.542085747s" totalImagesPullingTime="11.076372266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:02.541769706 +0000 UTC m=+142.237325802" watchObservedRunningTime="2026-07-27 19:28:02.542085747 +0000 UTC m=+142.237641843"
Jul 27 19:28:02.543777 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.543400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j" event={"ID":"597d0836-1571-439a-a7d6-2d4700cfadfa","Type":"ContainerStarted","Data":"4392746d8c5ed2625085a6cb2938fa4bebb3eaa40f8b1ed14b6375656c725f7c"}
Jul 27 19:28:02.546045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.545360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8" event={"ID":"fec2ae87-daa0-4829-9868-36e75c205276","Type":"ContainerStarted","Data":"e6bad0f18024aa76c073a91d8f359ce335ce5ecfee06ad4561e5a832c31bfeb3"}
Jul 27 19:28:02.546045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.546003    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:28:02.548500 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.548458    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8"
Jul 27 19:28:02.549346 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.549326    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/0.log"
Jul 27 19:28:02.549440 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.549366    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2b78ebb-f09f-4caf-88d7-3c37b2276539" containerID="233d09d766703798d472206de821c6b8f52c7ddc071d8b2d9c46d2dc2e978009" exitCode=255
Jul 27 19:28:02.549555 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.549529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" event={"ID":"a2b78ebb-f09f-4caf-88d7-3c37b2276539","Type":"ContainerDied","Data":"233d09d766703798d472206de821c6b8f52c7ddc071d8b2d9c46d2dc2e978009"}
Jul 27 19:28:02.549681 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.549651    2559 scope.go:117] "RemoveContainer" containerID="233d09d766703798d472206de821c6b8f52c7ddc071d8b2d9c46d2dc2e978009"
Jul 27 19:28:02.556318 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.556290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-vcgvv" event={"ID":"d0a9cc75-3c38-4758-9674-64a5e4ef0612","Type":"ContainerStarted","Data":"e9c1eff4ba3dcd43e3476bb7caf030994645fc39ff0f1e479090e761fab01ca3"}
Jul 27 19:28:02.557917 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.557899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fr7pm" event={"ID":"8e5dc63c-1fe2-42fb-8ce7-373b13831df8","Type":"ContainerStarted","Data":"a016d1a8bf8982119e729444570ff6ee126d90ed340cd096ae237740cf83de4a"}
Jul 27 19:28:02.561998 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.561957    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26" podStartSLOduration=11.812239792 podStartE2EDuration="22.561940039s" totalImagesPullingTime="10.749700247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:02.560870295 +0000 UTC m=+142.256426405" watchObservedRunningTime="2026-07-27 19:28:02.561940039 +0000 UTC m=+142.257496135"
Jul 27 19:28:02.589163 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.588950    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f" podStartSLOduration=11.934773496 podStartE2EDuration="22.588930694s" totalImagesPullingTime="10.654157198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:02.588265214 +0000 UTC m=+142.283821313" watchObservedRunningTime="2026-07-27 19:28:02.588930694 +0000 UTC m=+142.284486789"
Jul 27 19:28:02.662834 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.662781    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c8ldc" podStartSLOduration=11.835222375 podStartE2EDuration="22.662760468s" totalImagesPullingTime="10.827538093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:02.634119433 +0000 UTC m=+142.329675529" watchObservedRunningTime="2026-07-27 19:28:02.662760468 +0000 UTC m=+142.358316543"
Jul 27 19:28:02.663221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.663145    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-v664j" podStartSLOduration=11.667749915 podStartE2EDuration="22.663133176s" totalImagesPullingTime="10.995383261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:02.661215373 +0000 UTC m=+142.356771468" watchObservedRunningTime="2026-07-27 19:28:02.663133176 +0000 UTC m=+142.358689250"
Jul 27 19:28:02.688596 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:02.687818    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b4f56bbb-v5cp8" podStartSLOduration=11.904680482 podStartE2EDuration="22.68779932s" totalImagesPullingTime="10.783118838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:02.686646643 +0000 UTC m=+142.382202721" watchObservedRunningTime="2026-07-27 19:28:02.68779932 +0000 UTC m=+142.383355412"
Jul 27 19:28:03.563627 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.563550    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:28:03.565583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.564602    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/0.log"
Jul 27 19:28:03.565583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.564648    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2b78ebb-f09f-4caf-88d7-3c37b2276539" containerID="e229a787bcb98ea4a571fc0197b233511280d91da6b9e0fea6cc012303214d4f" exitCode=255
Jul 27 19:28:03.565583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.564728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" event={"ID":"a2b78ebb-f09f-4caf-88d7-3c37b2276539","Type":"ContainerDied","Data":"e229a787bcb98ea4a571fc0197b233511280d91da6b9e0fea6cc012303214d4f"}
Jul 27 19:28:03.565583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.564775    2559 scope.go:117] "RemoveContainer" containerID="233d09d766703798d472206de821c6b8f52c7ddc071d8b2d9c46d2dc2e978009"
Jul 27 19:28:03.565583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.565122    2559 scope.go:117] "RemoveContainer" containerID="e229a787bcb98ea4a571fc0197b233511280d91da6b9e0fea6cc012303214d4f"
Jul 27 19:28:03.565583 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:03.565332    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-r4gfr_openshift-console-operator(a2b78ebb-f09f-4caf-88d7-3c37b2276539)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" podUID="a2b78ebb-f09f-4caf-88d7-3c37b2276539"
Jul 27 19:28:03.568019 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.567580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fr7pm" event={"ID":"8e5dc63c-1fe2-42fb-8ce7-373b13831df8","Type":"ContainerStarted","Data":"e40dec8e368d57fb23da3ac585dcdad24fccc35494298830ae1aca37c89a3eca"}
Jul 27 19:28:03.568019 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.567643    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:28:03.571476 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.570501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" event={"ID":"da1a0f98-21f8-4874-9c69-804469078a0a","Type":"ContainerStarted","Data":"e80de79d9b335118b4eadb4749c2ce94e41fe267d8c06e018fd1952cf1240089"}
Jul 27 19:28:03.571476 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.570536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" event={"ID":"da1a0f98-21f8-4874-9c69-804469078a0a","Type":"ContainerStarted","Data":"4ad11d07ad3ffa45df0d8c107537b1ff829fab0dcb3485ccfb7a724feb6444c8"}
Jul 27 19:28:03.584242 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.584180    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-vcgvv" podStartSLOduration=12.802004034 podStartE2EDuration="23.584157513s" totalImagesPullingTime="10.782153479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:02.704370357 +0000 UTC m=+142.399926452" watchObservedRunningTime="2026-07-27 19:28:03.584157513 +0000 UTC m=+143.279713608"
Jul 27 19:28:03.605617 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.605558    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" podStartSLOduration=12.671361208 podStartE2EDuration="23.605539637s" totalImagesPullingTime="10.934178429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:03.605463886 +0000 UTC m=+143.301020000" watchObservedRunningTime="2026-07-27 19:28:03.605539637 +0000 UTC m=+143.301095733"
Jul 27 19:28:03.628895 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:03.628762    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fr7pm" podStartSLOduration=143.628740906 podStartE2EDuration="2m23.628740906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:03.627966618 +0000 UTC m=+143.323522737" watchObservedRunningTime="2026-07-27 19:28:03.628740906 +0000 UTC m=+143.324297014"
Jul 27 19:28:04.229638 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.228053    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b7zp7"]
Jul 27 19:28:04.234754 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.234527    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.238262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.237461    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:28:04.238262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.237749    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:28:04.238262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.238089    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qd54j\""
Jul 27 19:28:04.241338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.241267    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b7zp7"]
Jul 27 19:28:04.404889 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.404831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/976dd98b-aaf5-42b5-b150-934ad4dda614-crio-socket\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.405076 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.404993    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgfdg\" (UniqueName: \"kubernetes.io/projected/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-api-access-wgfdg\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.405076 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.405055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/976dd98b-aaf5-42b5-b150-934ad4dda614-data-volume\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.405199 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.405084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.405199 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.405109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.506408 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.506325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/976dd98b-aaf5-42b5-b150-934ad4dda614-crio-socket\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.506572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.506476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/976dd98b-aaf5-42b5-b150-934ad4dda614-crio-socket\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.506572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.506489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgfdg\" (UniqueName: \"kubernetes.io/projected/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-api-access-wgfdg\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.506572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.506553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/976dd98b-aaf5-42b5-b150-934ad4dda614-data-volume\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.506742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.506590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.506742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.506617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.506867 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:04.506731    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:28:04.506867 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:04.506757    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:04.506867 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:04.506811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:05.00678953 +0000 UTC m=+144.702345623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : configmap "kube-rbac-proxy" not found
Jul 27 19:28:04.506867 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:04.506831    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:05.006822198 +0000 UTC m=+144.702378278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:04.507054 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.506922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/976dd98b-aaf5-42b5-b150-934ad4dda614-data-volume\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.516707 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.516649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgfdg\" (UniqueName: \"kubernetes.io/projected/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-api-access-wgfdg\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:04.575901 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.575868    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:28:04.576349 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:04.576284    2559 scope.go:117] "RemoveContainer" containerID="e229a787bcb98ea4a571fc0197b233511280d91da6b9e0fea6cc012303214d4f"
Jul 27 19:28:04.576496 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:04.576472    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-r4gfr_openshift-console-operator(a2b78ebb-f09f-4caf-88d7-3c37b2276539)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" podUID="a2b78ebb-f09f-4caf-88d7-3c37b2276539"
Jul 27 19:28:05.011946 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:05.011902    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:05.011946 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:05.011952    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:05.012177 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.012032    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:28:05.012177 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.012097    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:06.012077301 +0000 UTC m=+145.707633410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : configmap "kube-rbac-proxy" not found
Jul 27 19:28:05.012177 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.012161    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:05.012298 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.012208    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:06.012195839 +0000 UTC m=+145.707751932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:05.379580 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.379489    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:28:05.380522 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.380485    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:28:05.381511 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.381477    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:28:05.381620 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:05.381527    2559 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerName="kube-multus-additional-cni-plugins" probeResult="unknown"
Jul 27 19:28:06.019427 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:06.019382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:06.020012 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:06.019437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:06.020012 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:06.019534    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:28:06.020012 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:06.019563    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:06.020012 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:06.019598    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:08.019577516 +0000 UTC m=+147.715133600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : configmap "kube-rbac-proxy" not found
Jul 27 19:28:06.020012 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:06.019750    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:08.019723929 +0000 UTC m=+147.715280013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:07.587090 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:07.587050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2hh9" event={"ID":"855ba6bc-d302-4d1d-b728-e39baf9c6393","Type":"ContainerStarted","Data":"617979c58f13c1af956d72e46ddae68e9576328f8df0d832a0eb7f21d80b84f0"}
Jul 27 19:28:07.602573 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:07.602519    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x2hh9" podStartSLOduration=142.435084369 podStartE2EDuration="2m26.602502543s" totalImagesPullingTime="4.167418174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:07.601659068 +0000 UTC m=+147.297215162" watchObservedRunningTime="2026-07-27 19:28:07.602502543 +0000 UTC m=+147.298058616"
Jul 27 19:28:08.033055 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:08.033002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:08.033055 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:08.033059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:08.033270 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:08.033125    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:28:08.033270 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:08.033186    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.033172671 +0000 UTC m=+151.728728747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : configmap "kube-rbac-proxy" not found
Jul 27 19:28:08.033270 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:08.033233    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:08.033369 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:08.033305    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:12.033291878 +0000 UTC m=+151.728847950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:09.720140 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:09.720111    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnd5h_b1423591-5924-49ef-aa8f-397afa5ff9ac/dns-node-resolver/0.log"
Jul 27 19:28:11.122196 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:11.122171    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfx74_935c5a73-81d4-4319-90f2-038e4f695dd9/node-ca/0.log"
Jul 27 19:28:11.361503 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:11.361454    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:28:11.361671 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:11.361558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:28:11.361907 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:11.361894    2559 scope.go:117] "RemoveContainer" containerID="e229a787bcb98ea4a571fc0197b233511280d91da6b9e0fea6cc012303214d4f"
Jul 27 19:28:11.362108 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:11.362088    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-r4gfr_openshift-console-operator(a2b78ebb-f09f-4caf-88d7-3c37b2276539)\"" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" podUID="a2b78ebb-f09f-4caf-88d7-3c37b2276539"
Jul 27 19:28:11.520787 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:11.520759    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c8ldc_f18b87cf-93b3-4ba6-8260-2efcfee5be08/serve-healthcheck-canary/0.log"
Jul 27 19:28:12.069368 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.069331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:12.069368 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.069368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:12.069579 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.069472    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:12.069579 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.069535    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls podName:976dd98b-aaf5-42b5-b150-934ad4dda614 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:20.06952167 +0000 UTC m=+159.765077741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b7zp7" (UID: "976dd98b-aaf5-42b5-b150-934ad4dda614") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:28:12.069824 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.069804    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/976dd98b-aaf5-42b5-b150-934ad4dda614-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:12.321091 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.321020    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26_f9094e27-933d-4f5e-ba44-6ddc0d76a6f4/kube-storage-version-migrator-operator/0.log"
Jul 27 19:28:12.371224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.371191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:28:12.371385 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.371287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:28:12.371385 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.371346    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:28:12.371385 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.371363    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55b4bd5d48-h6mvq: secret "image-registry-tls" not found
Jul 27 19:28:12.371508 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.371396    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:28:12.371508 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.371437    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls podName:133b853f-ec18-4f5a-91b0-503c10284cc9 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:44.371419132 +0000 UTC m=+184.066975227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls") pod "image-registry-55b4bd5d48-h6mvq" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9") : secret "image-registry-tls" not found
Jul 27 19:28:12.371508 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.371456    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls podName:f25992a9-9aaa-4bd9-aa0e-83c123afc97c nodeName:}" failed. No retries permitted until 2026-07-27 19:28:44.371446401 +0000 UTC m=+184.067002473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls") pod "dns-default-5b2kq" (UID: "f25992a9-9aaa-4bd9-aa0e-83c123afc97c") : secret "dns-default-metrics-tls" not found
Jul 27 19:28:12.519321 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.519295    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-qmgd5_3c9488fd-ab9f-4867-8d6f-b67f475b3da7/kube-multus-additional-cni-plugins/0.log"
Jul 27 19:28:12.673486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.673395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:12.673486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.673449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.673504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.673558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.673586    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:28:44.673562782 +0000 UTC m=+184.369118877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : configmap references non-existent config key: service-ca.crt
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.673615    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.673616    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.673659    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs podName:3a954648-6bb0-4672-817b-bfcb20c925db nodeName:}" failed. No retries permitted until 2026-07-27 19:28:44.673645529 +0000 UTC m=+184.369201602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs") pod "router-default-648c8c87b9-rl85h" (UID: "3a954648-6bb0-4672-817b-bfcb20c925db") : secret "router-metrics-certs-default" not found
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.673672    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls podName:36a1b7d0-2ff0-499f-a375-5eca85ae7b3c nodeName:}" failed. No retries permitted until 2026-07-27 19:28:44.673666553 +0000 UTC m=+184.369222624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mmxrs" (UID: "36a1b7d0-2ff0-499f-a375-5eca85ae7b3c") : secret "cluster-monitoring-operator-tls" not found
Jul 27 19:28:12.673722 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.673685    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 19:28:12.674017 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:12.673744    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls podName:501c4043-9669-4f01-bb1b-8ffdd7498bfa nodeName:}" failed. No retries permitted until 2026-07-27 19:28:44.673729969 +0000 UTC m=+184.369286042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls") pod "cluster-samples-operator-6748489656-8xvd2" (UID: "501c4043-9669-4f01-bb1b-8ffdd7498bfa") : secret "samples-operator-tls" not found
Jul 27 19:28:12.720921 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.720898    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9q9hc_5d4b3e91-7b1c-4803-9c39-aedc20ed3303/kube-multus/0.log"
Jul 27 19:28:12.920440 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:12.920412    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/egress-router-binary-copy/0.log"
Jul 27 19:28:13.120560 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:13.120532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/cni-plugins/0.log"
Jul 27 19:28:13.178230 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:13.178193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:28:13.178382 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:13.178339    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:28:13.178424 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:13.178401    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert podName:03221ef7-ec98-4d51-8ed9-9564a1ae597b nodeName:}" failed. No retries permitted until 2026-07-27 19:28:45.178385702 +0000 UTC m=+184.873941787 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-tgfb5" (UID: "03221ef7-ec98-4d51-8ed9-9564a1ae597b") : secret "networking-console-plugin-cert" not found
Jul 27 19:28:13.320011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:13.319981    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/bond-cni-plugin/0.log"
Jul 27 19:28:13.519898 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:13.519844    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/routeoverride-cni/0.log"
Jul 27 19:28:13.719909 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:13.719883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/whereabouts-cni-bincopy/0.log"
Jul 27 19:28:13.921231 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:13.921165    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/whereabouts-cni/0.log"
Jul 27 19:28:14.120153 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:14.120126    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/kube-multus-additional-cni-plugins/0.log"
Jul 27 19:28:15.379142 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:15.379101    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:28:15.380047 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:15.380016    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:28:15.380778 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:15.380756    2559 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" cmd=["/bin/bash","-c","test -f /ready/ready"]
Jul 27 19:28:15.380842 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:15.380794    2559 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerName="kube-multus-additional-cni-plugins" probeResult="unknown"
Jul 27 19:28:19.121057 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:19.121010    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:28:19.944906 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:19.944869    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gw4wp" podUID="9225ea5e-34f0-4663-bf0e-58ac3b59f78a"
Jul 27 19:28:20.143775 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.143739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:20.146056 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.146035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/976dd98b-aaf5-42b5-b150-934ad4dda614-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b7zp7\" (UID: \"976dd98b-aaf5-42b5-b150-934ad4dda614\") " pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:20.151979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.151960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b7zp7"
Jul 27 19:28:20.339404 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.339370    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b7zp7"]
Jul 27 19:28:20.342181 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:28:20.342151    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976dd98b_aaf5_42b5_b150_934ad4dda614.slice/crio-1eb360f89e05ffc3da34d4509108d30e9b3fa596a4af47a366edf939153dff1d WatchSource:0}: Error finding container 1eb360f89e05ffc3da34d4509108d30e9b3fa596a4af47a366edf939153dff1d: Status 404 returned error can't find the container with id 1eb360f89e05ffc3da34d4509108d30e9b3fa596a4af47a366edf939153dff1d
Jul 27 19:28:20.522140 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.522072    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-controller/0.log"
Jul 27 19:28:20.630565 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.630530    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7zp7" event={"ID":"976dd98b-aaf5-42b5-b150-934ad4dda614","Type":"ContainerStarted","Data":"1eb360f89e05ffc3da34d4509108d30e9b3fa596a4af47a366edf939153dff1d"}
Jul 27 19:28:20.722999 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.722970    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/1.log"
Jul 27 19:28:20.922000 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:20.921910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/kube-rbac-proxy-node/0.log"
Jul 27 19:28:21.121395 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.121367    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/kube-rbac-proxy-ovn-metrics/0.log"
Jul 27 19:28:21.321223 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.321197    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/northd/0.log"
Jul 27 19:28:21.486072 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.485958    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-qmgd5_3c9488fd-ab9f-4867-8d6f-b67f475b3da7/kube-multus-additional-cni-plugins/0.log"
Jul 27 19:28:21.496977 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.496676    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:28:21.522401 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.522364    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/nbdb/0.log"
Jul 27 19:28:21.556570 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.556526    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-tuning-conf-dir\") pod \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") "
Jul 27 19:28:21.556742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.556624    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-tuning-conf-dir" (OuterVolumeSpecName: "tuning-conf-dir") pod "3c9488fd-ab9f-4867-8d6f-b67f475b3da7" (UID: "3c9488fd-ab9f-4867-8d6f-b67f475b3da7"). InnerVolumeSpecName "tuning-conf-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Jul 27 19:28:21.556742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.556682    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-cni-sysctl-allowlist\") pod \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") "
Jul 27 19:28:21.556742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.556715    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dx7r\" (UniqueName: \"kubernetes.io/projected/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-kube-api-access-6dx7r\") pod \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") "
Jul 27 19:28:21.556931 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.556746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-ready\") pod \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\" (UID: \"3c9488fd-ab9f-4867-8d6f-b67f475b3da7\") "
Jul 27 19:28:21.557063 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.557045    2559 reconciler_common.go:299] "Volume detached for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-tuning-conf-dir\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:28:21.557355 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.557314    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-ready" (OuterVolumeSpecName: "ready") pod "3c9488fd-ab9f-4867-8d6f-b67f475b3da7" (UID: "3c9488fd-ab9f-4867-8d6f-b67f475b3da7"). InnerVolumeSpecName "ready". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:28:21.557469 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.557348    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "3c9488fd-ab9f-4867-8d6f-b67f475b3da7" (UID: "3c9488fd-ab9f-4867-8d6f-b67f475b3da7"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:21.560346 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.560302    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-kube-api-access-6dx7r" (OuterVolumeSpecName: "kube-api-access-6dx7r") pod "3c9488fd-ab9f-4867-8d6f-b67f475b3da7" (UID: "3c9488fd-ab9f-4867-8d6f-b67f475b3da7"). InnerVolumeSpecName "kube-api-access-6dx7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:21.637419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.637259    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-qmgd5_3c9488fd-ab9f-4867-8d6f-b67f475b3da7/kube-multus-additional-cni-plugins/0.log"
Jul 27 19:28:21.637419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.637307    2559 generic.go:356] "Generic (PLEG): container finished" podID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6" exitCode=137
Jul 27 19:28:21.637419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.637343    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" event={"ID":"3c9488fd-ab9f-4867-8d6f-b67f475b3da7","Type":"ContainerDied","Data":"68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6"}
Jul 27 19:28:21.637419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.637389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5" event={"ID":"3c9488fd-ab9f-4867-8d6f-b67f475b3da7","Type":"ContainerDied","Data":"6cc666dffafd43fe80800d223924f9b41549577c2f63e2b6862f69bf60b1a715"}
Jul 27 19:28:21.637419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.637415    2559 scope.go:117] "RemoveContainer" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6"
Jul 27 19:28:21.637802 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.637564    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-qmgd5"
Jul 27 19:28:21.658059 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.657815    2559 reconciler_common.go:299] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-cni-sysctl-allowlist\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:28:21.658059 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.657846    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dx7r\" (UniqueName: \"kubernetes.io/projected/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-kube-api-access-6dx7r\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:28:21.658059 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.657875    2559 reconciler_common.go:299] "Volume detached for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/3c9488fd-ab9f-4867-8d6f-b67f475b3da7-ready\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:28:21.658059 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.657970    2559 scope.go:117] "RemoveContainer" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6"
Jul 27 19:28:21.658488 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:28:21.658395    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6\": container with ID starting with 68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6 not found: ID does not exist" containerID="68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6"
Jul 27 19:28:21.658488 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.658434    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6"} err="failed to get container status \"68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6\": rpc error: code = NotFound desc = could not find container \"68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6\": container with ID starting with 68fd4ed225fbdd19c2f53c1dc47072595ce82a1d8eaf910030ae2939e4f21ec6 not found: ID does not exist"
Jul 27 19:28:21.663430 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.663404    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-qmgd5"]
Jul 27 19:28:21.668806 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.668754    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-qmgd5"]
Jul 27 19:28:21.720756 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.720730    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/sbdb/0.log"
Jul 27 19:28:21.925832 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:21.925806    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovnkube-controller/0.log"
Jul 27 19:28:22.940989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:22.940956    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" path="/var/lib/kubelet/pods/3c9488fd-ab9f-4867-8d6f-b67f475b3da7/volumes"
Jul 27 19:28:24.936359 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:24.936312    2559 scope.go:117] "RemoveContainer" containerID="e229a787bcb98ea4a571fc0197b233511280d91da6b9e0fea6cc012303214d4f"
Jul 27 19:28:26.921269 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:26.921243    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-v664j_597d0836-1571-439a-a7d6-2d4700cfadfa/check-endpoints/0.log"
Jul 27 19:28:27.321313 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:27.321284    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fr7pm_8e5dc63c-1fe2-42fb-8ce7-373b13831df8/network-check-target-container/0.log"
Jul 27 19:28:27.663017 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:27.662992    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:28:27.663173 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:27.663104    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" event={"ID":"a2b78ebb-f09f-4caf-88d7-3c37b2276539","Type":"ContainerStarted","Data":"769e28f1591e05dcbf82f58b02f24e50f145b348b977d364c9cec94eba12f1b0"}
Jul 27 19:28:27.663460 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:27.663440    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:28:27.664329 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:27.664310    2559 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-r4gfr container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.45:8443/readyz\": dial tcp 10.132.0.45:8443: connect: connection refused" start-of-body=
Jul 27 19:28:27.664423 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:27.664351    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" podUID="a2b78ebb-f09f-4caf-88d7-3c37b2276539" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.45:8443/readyz\": dial tcp 10.132.0.45:8443: connect: connection refused"
Jul 27 19:28:27.680302 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:27.680257    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr" podStartSLOduration=36.81384359 podStartE2EDuration="47.680242146s" totalImagesPullingTime="10.866398556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:27.67944132 +0000 UTC m=+167.374997415" watchObservedRunningTime="2026-07-27 19:28:27.680242146 +0000 UTC m=+167.375798240"
Jul 27 19:28:28.120425 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:28.120395    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lg6kn_302ba1e5-c018-480e-b208-25d58c4d1993/iptables-alerter/0.log"
Jul 27 19:28:28.669292 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:28.669244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7zp7" event={"ID":"976dd98b-aaf5-42b5-b150-934ad4dda614","Type":"ContainerStarted","Data":"dc4faefb4edff0634d664960cfc081e1a43e493a748b53aae7dddc05baf1fbd9"}
Jul 27 19:28:28.674570 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:28.674546    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-r4gfr"
Jul 27 19:28:30.938700 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:30.938667    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:28:31.682640 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:31.682610    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7zp7" event={"ID":"976dd98b-aaf5-42b5-b150-934ad4dda614","Type":"ContainerStarted","Data":"88d34e41c2467d5e0a4c66adb156be8475ba34c525585abc743ab7483d6c6aaf"}
Jul 27 19:28:34.579193 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:34.579160    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fr7pm"
Jul 27 19:28:35.697966 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:35.697930    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b7zp7" event={"ID":"976dd98b-aaf5-42b5-b150-934ad4dda614","Type":"ContainerStarted","Data":"7594288b66fe5730f2d7246df57c3f5d05174233194e0c66ad75db8136bd48fe"}
Jul 27 19:28:35.714222 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:35.714176    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b7zp7" podStartSLOduration=17.526848096 podStartE2EDuration="31.714161158s" totalImagesPullingTime="14.187313062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:28:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:35.713304424 +0000 UTC m=+175.408860518" watchObservedRunningTime="2026-07-27 19:28:35.714161158 +0000 UTC m=+175.409717252"
Jul 27 19:28:44.373352 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.373311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:28:44.373777 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.373404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:28:44.375580 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.375552    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f25992a9-9aaa-4bd9-aa0e-83c123afc97c-metrics-tls\") pod \"dns-default-5b2kq\" (UID: \"f25992a9-9aaa-4bd9-aa0e-83c123afc97c\") " pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:28:44.375688 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.375674    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"image-registry-55b4bd5d48-h6mvq\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") " pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:28:44.415341 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.415312    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h9pp5\""
Jul 27 19:28:44.423587 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.423566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:28:44.435815 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.435793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctr9s\""
Jul 27 19:28:44.444070 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.444051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:28:44.560468 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.560438    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55b4bd5d48-h6mvq"]
Jul 27 19:28:44.563522 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:28:44.563490    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133b853f_ec18_4f5a_91b0_503c10284cc9.slice/crio-d4a04de9369473b09d73fdacd53fd2cae383c39d245be9b8a4c456cfaae33ea3 WatchSource:0}: Error finding container d4a04de9369473b09d73fdacd53fd2cae383c39d245be9b8a4c456cfaae33ea3: Status 404 returned error can't find the container with id d4a04de9369473b09d73fdacd53fd2cae383c39d245be9b8a4c456cfaae33ea3
Jul 27 19:28:44.575065 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.575043    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5b2kq"]
Jul 27 19:28:44.577543 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:28:44.577521    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25992a9_9aaa_4bd9_aa0e_83c123afc97c.slice/crio-68ba7f55f9f95e6aeab79d84d04a4443e4a50d82644a22cad1a143b339d26d8b WatchSource:0}: Error finding container 68ba7f55f9f95e6aeab79d84d04a4443e4a50d82644a22cad1a143b339d26d8b: Status 404 returned error can't find the container with id 68ba7f55f9f95e6aeab79d84d04a4443e4a50d82644a22cad1a143b339d26d8b
Jul 27 19:28:44.677966 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.677926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:44.678126 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.678008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:28:44.678126 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.678059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:28:44.678207 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.678143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:44.678621 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.678596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a954648-6bb0-4672-817b-bfcb20c925db-service-ca-bundle\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:44.680411 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.680389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a954648-6bb0-4672-817b-bfcb20c925db-metrics-certs\") pod \"router-default-648c8c87b9-rl85h\" (UID: \"3a954648-6bb0-4672-817b-bfcb20c925db\") " pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:44.680495 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.680411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/36a1b7d0-2ff0-499f-a375-5eca85ae7b3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mmxrs\" (UID: \"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:28:44.680495 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.680454    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/501c4043-9669-4f01-bb1b-8ffdd7498bfa-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8xvd2\" (UID: \"501c4043-9669-4f01-bb1b-8ffdd7498bfa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:28:44.725735 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.725699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5b2kq" event={"ID":"f25992a9-9aaa-4bd9-aa0e-83c123afc97c","Type":"ContainerStarted","Data":"68ba7f55f9f95e6aeab79d84d04a4443e4a50d82644a22cad1a143b339d26d8b"}
Jul 27 19:28:44.727201 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.727169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq" event={"ID":"133b853f-ec18-4f5a-91b0-503c10284cc9","Type":"ContainerStarted","Data":"8c0f53af54ae6bae779fa6205a6ff8eea0ad89cb5190cf72745c0f6466cac28b"}
Jul 27 19:28:44.727335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.727218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq" event={"ID":"133b853f-ec18-4f5a-91b0-503c10284cc9","Type":"ContainerStarted","Data":"d4a04de9369473b09d73fdacd53fd2cae383c39d245be9b8a4c456cfaae33ea3"}
Jul 27 19:28:44.727335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.727249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:28:44.750179 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.750129    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq" podStartSLOduration=183.750113513 podStartE2EDuration="3m3.750113513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:44.749909219 +0000 UTC m=+184.445465314" watchObservedRunningTime="2026-07-27 19:28:44.750113513 +0000 UTC m=+184.445669607"
Jul 27 19:28:44.841278 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.841239    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jl2g8\""
Jul 27 19:28:44.849301 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.849265    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"
Jul 27 19:28:44.869530 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.869509    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wnsp8\""
Jul 27 19:28:44.878416 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.878287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:44.963482 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.963451    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mvg6x\""
Jul 27 19:28:44.966845 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.966818    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"
Jul 27 19:28:44.997131 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:44.997047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2"]
Jul 27 19:28:45.039262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.039227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-648c8c87b9-rl85h"]
Jul 27 19:28:45.130126 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.130053    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs"]
Jul 27 19:28:45.133432 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:28:45.133406    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a1b7d0_2ff0_499f_a375_5eca85ae7b3c.slice/crio-aa6be7dda3c6ab32a954a783ba2f7d890a94342674eceb3fa0359d98e3df7d55 WatchSource:0}: Error finding container aa6be7dda3c6ab32a954a783ba2f7d890a94342674eceb3fa0359d98e3df7d55: Status 404 returned error can't find the container with id aa6be7dda3c6ab32a954a783ba2f7d890a94342674eceb3fa0359d98e3df7d55
Jul 27 19:28:45.183599 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.183566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:28:45.186145 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.186076    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03221ef7-ec98-4d51-8ed9-9564a1ae597b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-tgfb5\" (UID: \"03221ef7-ec98-4d51-8ed9-9564a1ae597b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:28:45.332148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.332119    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nq2nz\""
Jul 27 19:28:45.340103 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.340074    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"
Jul 27 19:28:45.497341 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.497312    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5"]
Jul 27 19:28:45.501219 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:28:45.501194    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03221ef7_ec98_4d51_8ed9_9564a1ae597b.slice/crio-09cc7cc776287916667538ac606f91680b8f8ad0bd16aef88a618b0fb8ccf139 WatchSource:0}: Error finding container 09cc7cc776287916667538ac606f91680b8f8ad0bd16aef88a618b0fb8ccf139: Status 404 returned error can't find the container with id 09cc7cc776287916667538ac606f91680b8f8ad0bd16aef88a618b0fb8ccf139
Jul 27 19:28:45.733880 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.733741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5" event={"ID":"03221ef7-ec98-4d51-8ed9-9564a1ae597b","Type":"ContainerStarted","Data":"09cc7cc776287916667538ac606f91680b8f8ad0bd16aef88a618b0fb8ccf139"}
Jul 27 19:28:45.735226 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.735196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs" event={"ID":"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c","Type":"ContainerStarted","Data":"aa6be7dda3c6ab32a954a783ba2f7d890a94342674eceb3fa0359d98e3df7d55"}
Jul 27 19:28:45.736986 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.736952    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-648c8c87b9-rl85h" event={"ID":"3a954648-6bb0-4672-817b-bfcb20c925db","Type":"ContainerStarted","Data":"eea003aefe31679dc86c3e546d710dbfb53fc493e966db9cfca944cd9423a907"}
Jul 27 19:28:45.737112 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.736998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-648c8c87b9-rl85h" event={"ID":"3a954648-6bb0-4672-817b-bfcb20c925db","Type":"ContainerStarted","Data":"88c32a05898bbbad1b81430111a7977361cdc6f52c5df29c1690fc55b204b973"}
Jul 27 19:28:45.738428 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.738399    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2" event={"ID":"501c4043-9669-4f01-bb1b-8ffdd7498bfa","Type":"ContainerStarted","Data":"418869d56cd13fbf910d88e52982352883ef7917369e6d54483286793bbed3f4"}
Jul 27 19:28:45.755612 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.755543    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-648c8c87b9-rl85h" podStartSLOduration=65.755487933 podStartE2EDuration="1m5.755487933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:45.75500417 +0000 UTC m=+185.450560265" watchObservedRunningTime="2026-07-27 19:28:45.755487933 +0000 UTC m=+185.451044029"
Jul 27 19:28:45.879577 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.879543    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:45.882950 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:45.882806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:46.742879 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:46.742838    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:46.744327 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:46.744307    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-648c8c87b9-rl85h"
Jul 27 19:28:48.751745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.751706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5b2kq" event={"ID":"f25992a9-9aaa-4bd9-aa0e-83c123afc97c","Type":"ContainerStarted","Data":"9268b6d381b422a18ea79aae56926c64ed3b1abf47a4c5e2468deca5cd41c74f"}
Jul 27 19:28:48.752179 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.751761    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5b2kq" event={"ID":"f25992a9-9aaa-4bd9-aa0e-83c123afc97c","Type":"ContainerStarted","Data":"4fcf602946a56ef5835bf034919e10ba95950a47b6f9ca4b9cd88ec9cf954863"}
Jul 27 19:28:48.752179 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.751809    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:28:48.753411 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.753390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2" event={"ID":"501c4043-9669-4f01-bb1b-8ffdd7498bfa","Type":"ContainerStarted","Data":"bcfba291ba73807538dabc647728946fc2daae72b62c0108aebc9aed6f5c58f0"}
Jul 27 19:28:48.753518 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.753432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2" event={"ID":"501c4043-9669-4f01-bb1b-8ffdd7498bfa","Type":"ContainerStarted","Data":"34241526dad8d9d84574bc11487e058379dc09db9b3b53328bf67b659a06fec7"}
Jul 27 19:28:48.754695 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.754662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5" event={"ID":"03221ef7-ec98-4d51-8ed9-9564a1ae597b","Type":"ContainerStarted","Data":"fc5994de6dc613caa81b162736690ca04837b70bba823e5f2e0d7943436e7a45"}
Jul 27 19:28:48.756046 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.756026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs" event={"ID":"36a1b7d0-2ff0-499f-a375-5eca85ae7b3c","Type":"ContainerStarted","Data":"68349efc155cd58e9e21fa113cb22939e0ee7ca4058580958c55a52790447a43"}
Jul 27 19:28:48.777040 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.776999    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5b2kq" podStartSLOduration=65.66880082 podStartE2EDuration="1m8.776986081s" totalImagesPullingTime="3.108185261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:48.776096135 +0000 UTC m=+188.471652229" watchObservedRunningTime="2026-07-27 19:28:48.776986081 +0000 UTC m=+188.472542174"
Jul 27 19:28:48.802238 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.802195    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-tgfb5" podStartSLOduration=66.579343494 podStartE2EDuration="1m8.802180561s" totalImagesPullingTime="2.222837067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:48.801306314 +0000 UTC m=+188.496862409" watchObservedRunningTime="2026-07-27 19:28:48.802180561 +0000 UTC m=+188.497736682"
Jul 27 19:28:48.839118 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.839062    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8xvd2" podStartSLOduration=66.22006666 podStartE2EDuration="1m8.839046267s" totalImagesPullingTime="2.618979607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:48.837832937 +0000 UTC m=+188.533389032" watchObservedRunningTime="2026-07-27 19:28:48.839046267 +0000 UTC m=+188.534602361"
Jul 27 19:28:48.872272 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:48.872226    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mmxrs" podStartSLOduration=66.320309665 podStartE2EDuration="1m8.872209997s" totalImagesPullingTime="2.551900332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:48.870921634 +0000 UTC m=+188.566477727" watchObservedRunningTime="2026-07-27 19:28:48.872209997 +0000 UTC m=+188.567766091"
Jul 27 19:28:54.208209 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:54.208175    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55b4bd5d48-h6mvq"]
Jul 27 19:28:56.715800 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.715769    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8w7d2"]
Jul 27 19:28:56.716179 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.716073    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerName="kube-multus-additional-cni-plugins"
Jul 27 19:28:56.716179 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.716086    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerName="kube-multus-additional-cni-plugins"
Jul 27 19:28:56.716179 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.716137    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c9488fd-ab9f-4867-8d6f-b67f475b3da7" containerName="kube-multus-additional-cni-plugins"
Jul 27 19:28:56.719153 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.719135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.721489 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.721463    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:28:56.721489 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.721485    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:28:56.721489 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.721488    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:28:56.721727 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.721609    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kxzxm\""
Jul 27 19:28:56.721845 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.721829    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:28:56.796780 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-wtmp\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.796938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.796938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-textfile\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.796938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-metrics-client-ca\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.796938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-sys\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.796938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42fr6\" (UniqueName: \"kubernetes.io/projected/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-kube-api-access-42fr6\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.797102 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.797102 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.796992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-root\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.797102 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.797009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-tls\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.897954 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.897921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-textfile\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.897954 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.897955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-metrics-client-ca\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.897982    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-sys\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42fr6\" (UniqueName: \"kubernetes.io/projected/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-kube-api-access-42fr6\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-sys\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-root\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898390 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-tls\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898390 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-root\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898390 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-wtmp\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898390 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898390 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-textfile\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898636 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-wtmp\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898636 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898618    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-metrics-client-ca\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.898751 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.898715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.900494 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.900475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.900639 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.900623    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-node-exporter-tls\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:56.909728 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:56.909698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42fr6\" (UniqueName: \"kubernetes.io/projected/165e87ff-6b19-42ea-a69e-c0e5dd4e88c0-kube-api-access-42fr6\") pod \"node-exporter-8w7d2\" (UID: \"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0\") " pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:57.029258 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:57.029173    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8w7d2"
Jul 27 19:28:57.039355 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:28:57.039325    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165e87ff_6b19_42ea_a69e_c0e5dd4e88c0.slice/crio-536585f2aa9dde0e94b436172613de28032909e9b5fb51fa94eee4c7b2d54acd WatchSource:0}: Error finding container 536585f2aa9dde0e94b436172613de28032909e9b5fb51fa94eee4c7b2d54acd: Status 404 returned error can't find the container with id 536585f2aa9dde0e94b436172613de28032909e9b5fb51fa94eee4c7b2d54acd
Jul 27 19:28:57.793025 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:57.792991    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8w7d2" event={"ID":"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0","Type":"ContainerStarted","Data":"536585f2aa9dde0e94b436172613de28032909e9b5fb51fa94eee4c7b2d54acd"}
Jul 27 19:28:58.762219 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:58.762183    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5b2kq"
Jul 27 19:28:58.799218 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:58.799186    2559 generic.go:356] "Generic (PLEG): container finished" podID="165e87ff-6b19-42ea-a69e-c0e5dd4e88c0" containerID="64352bed7639007689951b35083e794623ba73e40d110e3801707f489d9df90e" exitCode=0
Jul 27 19:28:58.799647 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:58.799264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8w7d2" event={"ID":"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0","Type":"ContainerDied","Data":"64352bed7639007689951b35083e794623ba73e40d110e3801707f489d9df90e"}
Jul 27 19:28:59.805966 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:59.805922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8w7d2" event={"ID":"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0","Type":"ContainerStarted","Data":"1d6ef7a72923074f9aba98565db7d20620b46e2d69bfc4d18341233a6eb13823"}
Jul 27 19:28:59.806354 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:59.805978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8w7d2" event={"ID":"165e87ff-6b19-42ea-a69e-c0e5dd4e88c0","Type":"ContainerStarted","Data":"3165b695f6817fc33b10b3329e4be3ef8ffea32abc960d7d03cc775ecd2b418a"}
Jul 27 19:28:59.828508 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:28:59.828457    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8w7d2" podStartSLOduration=2.504536215 podStartE2EDuration="3.828440516s" totalImagesPullingTime="1.22613318s" totalInitContainerRuntime="97.771121ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:59.82707108 +0000 UTC m=+199.522627175" watchObservedRunningTime="2026-07-27 19:28:59.828440516 +0000 UTC m=+199.523996611"
Jul 27 19:29:04.215048 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:04.215019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:29:19.227193 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:19.227130    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq" podUID="133b853f-ec18-4f5a-91b0-503c10284cc9" containerName="registry" containerID="cri-o://8c0f53af54ae6bae779fa6205a6ff8eea0ad89cb5190cf72745c0f6466cac28b" gracePeriod=30
Jul 27 19:29:19.878541 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:19.878508    2559 generic.go:356] "Generic (PLEG): container finished" podID="133b853f-ec18-4f5a-91b0-503c10284cc9" containerID="8c0f53af54ae6bae779fa6205a6ff8eea0ad89cb5190cf72745c0f6466cac28b" exitCode=0
Jul 27 19:29:19.878716 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:19.878586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq" event={"ID":"133b853f-ec18-4f5a-91b0-503c10284cc9","Type":"ContainerDied","Data":"8c0f53af54ae6bae779fa6205a6ff8eea0ad89cb5190cf72745c0f6466cac28b"}
Jul 27 19:29:20.012698 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.012671    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:29:20.107292 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107252    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wgq9\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-kube-api-access-6wgq9\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.107486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107305    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.107486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107340    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-image-registry-private-configuration\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.107486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107372    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/133b853f-ec18-4f5a-91b0-503c10284cc9-ca-trust-extracted\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.107486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107404    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-trusted-ca\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.107486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107430    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-bound-sa-token\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.107486 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107466    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-installation-pull-secrets\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.107774 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.107525    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-certificates\") pod \"133b853f-ec18-4f5a-91b0-503c10284cc9\" (UID: \"133b853f-ec18-4f5a-91b0-503c10284cc9\") "
Jul 27 19:29:20.108100 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.108045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:29:20.108216 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.108119    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:29:20.110012 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.109985    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-kube-api-access-6wgq9" (OuterVolumeSpecName: "kube-api-access-6wgq9") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "kube-api-access-6wgq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:20.110123 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.110044    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:20.110123 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.110090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:20.110209 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.110124    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:20.110273 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.110256    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:20.116530 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.116494    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/133b853f-ec18-4f5a-91b0-503c10284cc9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "133b853f-ec18-4f5a-91b0-503c10284cc9" (UID: "133b853f-ec18-4f5a-91b0-503c10284cc9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:20.208748 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208709    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-tls\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.208748 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208741    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-image-registry-private-configuration\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.208748 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208751    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/133b853f-ec18-4f5a-91b0-503c10284cc9-ca-trust-extracted\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.208748 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208761    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-trusted-ca\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.209048 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208770    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-bound-sa-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.209048 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208778    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/133b853f-ec18-4f5a-91b0-503c10284cc9-installation-pull-secrets\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.209048 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208786    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/133b853f-ec18-4f5a-91b0-503c10284cc9-registry-certificates\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.209048 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.208798    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wgq9\" (UniqueName: \"kubernetes.io/projected/133b853f-ec18-4f5a-91b0-503c10284cc9-kube-api-access-6wgq9\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:29:20.882650 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.882612    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq" event={"ID":"133b853f-ec18-4f5a-91b0-503c10284cc9","Type":"ContainerDied","Data":"d4a04de9369473b09d73fdacd53fd2cae383c39d245be9b8a4c456cfaae33ea3"}
Jul 27 19:29:20.883136 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.882672    2559 scope.go:117] "RemoveContainer" containerID="8c0f53af54ae6bae779fa6205a6ff8eea0ad89cb5190cf72745c0f6466cac28b"
Jul 27 19:29:20.883136 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.882633    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b4bd5d48-h6mvq"
Jul 27 19:29:20.901974 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.901951    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55b4bd5d48-h6mvq"]
Jul 27 19:29:20.905776 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.905752    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55b4bd5d48-h6mvq"]
Jul 27 19:29:20.940502 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:20.940469    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="133b853f-ec18-4f5a-91b0-503c10284cc9" path="/var/lib/kubelet/pods/133b853f-ec18-4f5a-91b0-503c10284cc9/volumes"
Jul 27 19:29:28.912300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:28.912262    2559 generic.go:356] "Generic (PLEG): container finished" podID="f9094e27-933d-4f5e-ba44-6ddc0d76a6f4" containerID="6895c15c43c11ccdf392e6372d818d6961f829710fec5e8361d051f75479b510" exitCode=0
Jul 27 19:29:28.912708 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:28.912338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26" event={"ID":"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4","Type":"ContainerDied","Data":"6895c15c43c11ccdf392e6372d818d6961f829710fec5e8361d051f75479b510"}
Jul 27 19:29:28.912708 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:28.912646    2559 scope.go:117] "RemoveContainer" containerID="6895c15c43c11ccdf392e6372d818d6961f829710fec5e8361d051f75479b510"
Jul 27 19:29:29.917572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:29.917539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26" event={"ID":"f9094e27-933d-4f5e-ba44-6ddc0d76a6f4","Type":"ContainerStarted","Data":"02b7c07ecec4d7496aaf9721f61c399edcd47c2404bfffe8d22f1d92e695a29f"}
Jul 27 19:29:33.933847 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:33.933810    2559 generic.go:356] "Generic (PLEG): container finished" podID="d0a9cc75-3c38-4758-9674-64a5e4ef0612" containerID="e9c1eff4ba3dcd43e3476bb7caf030994645fc39ff0f1e479090e761fab01ca3" exitCode=0
Jul 27 19:29:33.934311 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:33.933884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-vcgvv" event={"ID":"d0a9cc75-3c38-4758-9674-64a5e4ef0612","Type":"ContainerDied","Data":"e9c1eff4ba3dcd43e3476bb7caf030994645fc39ff0f1e479090e761fab01ca3"}
Jul 27 19:29:33.934311 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:33.934215    2559 scope.go:117] "RemoveContainer" containerID="e9c1eff4ba3dcd43e3476bb7caf030994645fc39ff0f1e479090e761fab01ca3"
Jul 27 19:29:33.935389 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:33.935366    2559 generic.go:356] "Generic (PLEG): container finished" podID="613f0bd9-0f9f-4a89-87e8-b9e2db5be64a" containerID="2df50dc257c250f747db608eb9896371ade8262da0af2986065b02d5b3fccdce" exitCode=0
Jul 27 19:29:33.935502 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:33.935439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f" event={"ID":"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a","Type":"ContainerDied","Data":"2df50dc257c250f747db608eb9896371ade8262da0af2986065b02d5b3fccdce"}
Jul 27 19:29:33.935744 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:33.935718    2559 scope.go:117] "RemoveContainer" containerID="2df50dc257c250f747db608eb9896371ade8262da0af2986065b02d5b3fccdce"
Jul 27 19:29:34.941539 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:34.941492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-vcgvv" event={"ID":"d0a9cc75-3c38-4758-9674-64a5e4ef0612","Type":"ContainerStarted","Data":"ffcd0a666164c7ca110bd5b6cebaa9ddbf8a988e12c791673f82cb67bb4e18a2"}
Jul 27 19:29:34.942943 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:34.942920    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8c56f" event={"ID":"613f0bd9-0f9f-4a89-87e8-b9e2db5be64a","Type":"ContainerStarted","Data":"8eb6894a3c05d9f983fb599f180e5a01db9614e3afb0b6a6f902c4650a3caaca"}
Jul 27 19:29:41.313532 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:41.313491    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" podUID="da1a0f98-21f8-4874-9c69-804469078a0a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 19:29:51.313491 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:51.313449    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" podUID="da1a0f98-21f8-4874-9c69-804469078a0a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 19:29:52.584164 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:52.584114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:29:52.586392 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:52.586371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9225ea5e-34f0-4663-bf0e-58ac3b59f78a-metrics-certs\") pod \"network-metrics-daemon-gw4wp\" (UID: \"9225ea5e-34f0-4663-bf0e-58ac3b59f78a\") " pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:29:52.842198 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:52.842120    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4682l\""
Jul 27 19:29:52.849995 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:52.849973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw4wp"
Jul 27 19:29:52.979335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:52.979174    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gw4wp"]
Jul 27 19:29:52.982150 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:29:52.982114    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9225ea5e_34f0_4663_bf0e_58ac3b59f78a.slice/crio-d3aee5a8e7382b5787131adc01e478e8dce3be5f1faf51683fdd778957dd4eac WatchSource:0}: Error finding container d3aee5a8e7382b5787131adc01e478e8dce3be5f1faf51683fdd778957dd4eac: Status 404 returned error can't find the container with id d3aee5a8e7382b5787131adc01e478e8dce3be5f1faf51683fdd778957dd4eac
Jul 27 19:29:53.014396 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:53.014361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gw4wp" event={"ID":"9225ea5e-34f0-4663-bf0e-58ac3b59f78a","Type":"ContainerStarted","Data":"d3aee5a8e7382b5787131adc01e478e8dce3be5f1faf51683fdd778957dd4eac"}
Jul 27 19:29:55.024063 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:55.024024    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gw4wp" event={"ID":"9225ea5e-34f0-4663-bf0e-58ac3b59f78a","Type":"ContainerStarted","Data":"1fa941884e24ea71c32f563de4c77becf4b5470e474898f8b54e662c91e7d6fc"}
Jul 27 19:29:55.024451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:55.024086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gw4wp" event={"ID":"9225ea5e-34f0-4663-bf0e-58ac3b59f78a","Type":"ContainerStarted","Data":"79ea1409ac76abf02896a927ee3d36353f14d600ddb5c898b7061245510beaf8"}
Jul 27 19:29:55.040379 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:29:55.040324    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gw4wp" podStartSLOduration=254.045999208 podStartE2EDuration="4m15.040310191s" totalImagesPullingTime="994.310983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:55.039214204 +0000 UTC m=+254.734770298" watchObservedRunningTime="2026-07-27 19:29:55.040310191 +0000 UTC m=+254.735866309"
Jul 27 19:30:01.313371 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:01.313330    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" podUID="da1a0f98-21f8-4874-9c69-804469078a0a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 19:30:01.313803 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:01.313410    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l"
Jul 27 19:30:01.313975 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:01.313956    2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e80de79d9b335118b4eadb4749c2ce94e41fe267d8c06e018fd1952cf1240089"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 27 19:30:01.314019 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:01.313997    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" podUID="da1a0f98-21f8-4874-9c69-804469078a0a" containerName="service-proxy" containerID="cri-o://e80de79d9b335118b4eadb4749c2ce94e41fe267d8c06e018fd1952cf1240089" gracePeriod=30
Jul 27 19:30:02.053937 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:02.053836    2559 generic.go:356] "Generic (PLEG): container finished" podID="da1a0f98-21f8-4874-9c69-804469078a0a" containerID="e80de79d9b335118b4eadb4749c2ce94e41fe267d8c06e018fd1952cf1240089" exitCode=2
Jul 27 19:30:02.053937 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:02.053918    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" event={"ID":"da1a0f98-21f8-4874-9c69-804469078a0a","Type":"ContainerDied","Data":"e80de79d9b335118b4eadb4749c2ce94e41fe267d8c06e018fd1952cf1240089"}
Jul 27 19:30:02.054175 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:02.053975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8459dbd967-b6s2l" event={"ID":"da1a0f98-21f8-4874-9c69-804469078a0a","Type":"ContainerStarted","Data":"2f5fe103ef987205159367398324b13d05d0a9f21c9f433b6b7a4a23bfe9733c"}
Jul 27 19:30:40.734630 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:40.734603    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:30:40.739608 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:40.739573    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:30:40.739965 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:40.739945    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:30:40.747350 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:40.747319    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:30:40.749398 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:30:40.749367    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:33:31.614131 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.614102    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"]
Jul 27 19:33:31.614560 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.614362    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="133b853f-ec18-4f5a-91b0-503c10284cc9" containerName="registry"
Jul 27 19:33:31.614560 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.614372    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="133b853f-ec18-4f5a-91b0-503c10284cc9" containerName="registry"
Jul 27 19:33:31.614560 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.614432    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="133b853f-ec18-4f5a-91b0-503c10284cc9" containerName="registry"
Jul 27 19:33:31.617342 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.617320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.619843 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.619820    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:33:31.619962 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.619822    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:33:31.619962 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.619884    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:33:31.620086 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.619968    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:33:31.620086 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.619973    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lhqz6\""
Jul 27 19:33:31.632670 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.632321    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"]
Jul 27 19:33:31.641829 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.641796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.642008 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.641837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-tmp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.642008 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.641897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc75f\" (UniqueName: \"kubernetes.io/projected/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-kube-api-access-dc75f\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.642008 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.641919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-manifests\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.642008 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.641945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.742901 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.742837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.743085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.742931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.743085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.742958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-tmp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.743085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.742986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc75f\" (UniqueName: \"kubernetes.io/projected/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-kube-api-access-dc75f\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.743085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.743008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-manifests\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.743417 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.743398    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-manifests\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.745222 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.745179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-tmp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.745375 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.745355    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.745504 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.745485    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.761585 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.761564    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc75f\" (UniqueName: \"kubernetes.io/projected/b9fa83b1-eb0e-479e-a9de-77f5fbeec46c-kube-api-access-dc75f\") pod \"opendatahub-operator-controller-manager-787b9f94c8-zt4bf\" (UID: \"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:31.927598 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:31.927572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:32.057024 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:32.056992    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"]
Jul 27 19:33:32.060538 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:33:32.060512    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fa83b1_eb0e_479e_a9de_77f5fbeec46c.slice/crio-f2dc21b7d09e50f9955d2c20f38fdc3b6115f62e9fd57fa090a988965bff45f6 WatchSource:0}: Error finding container f2dc21b7d09e50f9955d2c20f38fdc3b6115f62e9fd57fa090a988965bff45f6: Status 404 returned error can't find the container with id f2dc21b7d09e50f9955d2c20f38fdc3b6115f62e9fd57fa090a988965bff45f6
Jul 27 19:33:32.062167 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:32.062151    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:33:32.830291 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:32.830236    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf" event={"ID":"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c","Type":"ContainerStarted","Data":"f2dc21b7d09e50f9955d2c20f38fdc3b6115f62e9fd57fa090a988965bff45f6"}
Jul 27 19:33:35.845090 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:35.845053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf" event={"ID":"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c","Type":"ContainerStarted","Data":"e6abbb0b0c055dfa928b69630279a1993ff300cb5487e0dcf21967e2c4ca05d6"}
Jul 27 19:33:36.850541 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:36.850506    2559 generic.go:356] "Generic (PLEG): container finished" podID="b9fa83b1-eb0e-479e-a9de-77f5fbeec46c" containerID="e6abbb0b0c055dfa928b69630279a1993ff300cb5487e0dcf21967e2c4ca05d6" exitCode=0
Jul 27 19:33:36.850947 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:36.850589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf" event={"ID":"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c","Type":"ContainerDied","Data":"e6abbb0b0c055dfa928b69630279a1993ff300cb5487e0dcf21967e2c4ca05d6"}
Jul 27 19:33:37.857423 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:37.857384    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf" event={"ID":"b9fa83b1-eb0e-479e-a9de-77f5fbeec46c","Type":"ContainerStarted","Data":"300540d8af9bf6064001740f90a83b6f7a67c955d789ecde64d34668cce3a2df"}
Jul 27 19:33:37.857813 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:37.857492    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:37.880306 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:37.880262    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf" podStartSLOduration=2.222861127 podStartE2EDuration="6.8802442s" totalImagesPullingTime="3.631317789s" totalInitContainerRuntime="1.026065284s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:37.87902606 +0000 UTC m=+477.574582178" watchObservedRunningTime="2026-07-27 19:33:37.8802442 +0000 UTC m=+477.575800294"
Jul 27 19:33:48.864388 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:48.864356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-zt4bf"
Jul 27 19:33:51.544350 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.544309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kq5nd"]
Jul 27 19:33:51.560191 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.560162    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kq5nd"]
Jul 27 19:33:51.560337 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.560258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:51.562831 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.562800    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 19:33:51.563061 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.563041    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-sm856\""
Jul 27 19:33:51.611508 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.611475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tnfg\" (UniqueName: \"kubernetes.io/projected/4f0ccd3c-cc83-4127-998c-22e11cd64c7c-kube-api-access-4tnfg\") pod \"odh-model-controller-7998c67dc4-kq5nd\" (UID: \"4f0ccd3c-cc83-4127-998c-22e11cd64c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:51.611659 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.611517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f0ccd3c-cc83-4127-998c-22e11cd64c7c-cert\") pod \"odh-model-controller-7998c67dc4-kq5nd\" (UID: \"4f0ccd3c-cc83-4127-998c-22e11cd64c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:51.711990 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.711944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tnfg\" (UniqueName: \"kubernetes.io/projected/4f0ccd3c-cc83-4127-998c-22e11cd64c7c-kube-api-access-4tnfg\") pod \"odh-model-controller-7998c67dc4-kq5nd\" (UID: \"4f0ccd3c-cc83-4127-998c-22e11cd64c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:51.712170 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.712010    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f0ccd3c-cc83-4127-998c-22e11cd64c7c-cert\") pod \"odh-model-controller-7998c67dc4-kq5nd\" (UID: \"4f0ccd3c-cc83-4127-998c-22e11cd64c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:51.714477 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.714445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f0ccd3c-cc83-4127-998c-22e11cd64c7c-cert\") pod \"odh-model-controller-7998c67dc4-kq5nd\" (UID: \"4f0ccd3c-cc83-4127-998c-22e11cd64c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:51.719844 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.719813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tnfg\" (UniqueName: \"kubernetes.io/projected/4f0ccd3c-cc83-4127-998c-22e11cd64c7c-kube-api-access-4tnfg\") pod \"odh-model-controller-7998c67dc4-kq5nd\" (UID: \"4f0ccd3c-cc83-4127-998c-22e11cd64c7c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:51.871688 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:51.871588    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:52.032426 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.032350    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kq5nd"]
Jul 27 19:33:52.034924 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:33:52.034898    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0ccd3c_cc83_4127_998c_22e11cd64c7c.slice/crio-1264375e9f4616764e4e9adc0764fea3f809c1323e9f137b305bfad3c883a6ef WatchSource:0}: Error finding container 1264375e9f4616764e4e9adc0764fea3f809c1323e9f137b305bfad3c883a6ef: Status 404 returned error can't find the container with id 1264375e9f4616764e4e9adc0764fea3f809c1323e9f137b305bfad3c883a6ef
Jul 27 19:33:52.208090 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.208057    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pzrqd"]
Jul 27 19:33:52.212398 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.212377    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.214759 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.214736    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 19:33:52.214915 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.214740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-trwqt\""
Jul 27 19:33:52.220756 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.220733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pzrqd"]
Jul 27 19:33:52.315762 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.315727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854ca60e-d0b6-4c3b-a2f5-41181dec5241-tls-certs\") pod \"model-serving-api-54d89bd5fc-pzrqd\" (UID: \"854ca60e-d0b6-4c3b-a2f5-41181dec5241\") " pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.315966 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.315774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjgm\" (UniqueName: \"kubernetes.io/projected/854ca60e-d0b6-4c3b-a2f5-41181dec5241-kube-api-access-ckjgm\") pod \"model-serving-api-54d89bd5fc-pzrqd\" (UID: \"854ca60e-d0b6-4c3b-a2f5-41181dec5241\") " pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.416776 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.416741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854ca60e-d0b6-4c3b-a2f5-41181dec5241-tls-certs\") pod \"model-serving-api-54d89bd5fc-pzrqd\" (UID: \"854ca60e-d0b6-4c3b-a2f5-41181dec5241\") " pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.416776 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.416780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjgm\" (UniqueName: \"kubernetes.io/projected/854ca60e-d0b6-4c3b-a2f5-41181dec5241-kube-api-access-ckjgm\") pod \"model-serving-api-54d89bd5fc-pzrqd\" (UID: \"854ca60e-d0b6-4c3b-a2f5-41181dec5241\") " pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.419369 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.419338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/854ca60e-d0b6-4c3b-a2f5-41181dec5241-tls-certs\") pod \"model-serving-api-54d89bd5fc-pzrqd\" (UID: \"854ca60e-d0b6-4c3b-a2f5-41181dec5241\") " pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.425161 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.425138    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjgm\" (UniqueName: \"kubernetes.io/projected/854ca60e-d0b6-4c3b-a2f5-41181dec5241-kube-api-access-ckjgm\") pod \"model-serving-api-54d89bd5fc-pzrqd\" (UID: \"854ca60e-d0b6-4c3b-a2f5-41181dec5241\") " pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.524340 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.524248    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:52.667032 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.666932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pzrqd"]
Jul 27 19:33:52.669605 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:33:52.669564    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854ca60e_d0b6_4c3b_a2f5_41181dec5241.slice/crio-f0c05d49ff7b19392b75a157dc6b1f3eb6f11562b26cccde11d70804d7e849c8 WatchSource:0}: Error finding container f0c05d49ff7b19392b75a157dc6b1f3eb6f11562b26cccde11d70804d7e849c8: Status 404 returned error can't find the container with id f0c05d49ff7b19392b75a157dc6b1f3eb6f11562b26cccde11d70804d7e849c8
Jul 27 19:33:52.921754 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.921670    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd" event={"ID":"854ca60e-d0b6-4c3b-a2f5-41181dec5241","Type":"ContainerStarted","Data":"f0c05d49ff7b19392b75a157dc6b1f3eb6f11562b26cccde11d70804d7e849c8"}
Jul 27 19:33:52.923221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:52.923191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd" event={"ID":"4f0ccd3c-cc83-4127-998c-22e11cd64c7c","Type":"ContainerStarted","Data":"1264375e9f4616764e4e9adc0764fea3f809c1323e9f137b305bfad3c883a6ef"}
Jul 27 19:33:55.939308 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:55.939259    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd" event={"ID":"4f0ccd3c-cc83-4127-998c-22e11cd64c7c","Type":"ContainerStarted","Data":"1cd76d9a5b0ffe0cd3e71cb1755081aa6b4736070c3c72d2a9d9d77197f2851d"}
Jul 27 19:33:55.939786 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:55.939406    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:33:55.941360 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:55.941335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd" event={"ID":"854ca60e-d0b6-4c3b-a2f5-41181dec5241","Type":"ContainerStarted","Data":"541e31e01b08c2b217e94bdeb03d0ae8aa078c4faac79c16bb98d5cc511135c6"}
Jul 27 19:33:55.941497 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:55.941455    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:33:55.961127 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:55.961077    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd" podStartSLOduration=1.449728865 podStartE2EDuration="4.961060524s" totalImagesPullingTime="3.511331659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:55.960712002 +0000 UTC m=+495.656268096" watchObservedRunningTime="2026-07-27 19:33:55.961060524 +0000 UTC m=+495.656616619"
Jul 27 19:33:55.978480 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:55.978421    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd" podStartSLOduration=1.104497026 podStartE2EDuration="3.978406365s" totalImagesPullingTime="2.873909339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:55.977073739 +0000 UTC m=+495.672629835" watchObservedRunningTime="2026-07-27 19:33:55.978406365 +0000 UTC m=+495.673962458"
Jul 27 19:33:56.932846 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:56.932813    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"]
Jul 27 19:33:56.936015 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:56.935987    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:56.938147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:56.938126    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hhv8b\""
Jul 27 19:33:56.938255 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:56.938127    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 19:33:56.938301 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:56.938130    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 19:33:56.945904 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:56.945883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"]
Jul 27 19:33:57.056273 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.056237    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83eae4a6-489b-489a-9f2a-e76ccb890f6f-tmp\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.056472 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.056298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83eae4a6-489b-489a-9f2a-e76ccb890f6f-tls-certs\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.056472 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.056317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pkv2\" (UniqueName: \"kubernetes.io/projected/83eae4a6-489b-489a-9f2a-e76ccb890f6f-kube-api-access-9pkv2\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.157619 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.157576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83eae4a6-489b-489a-9f2a-e76ccb890f6f-tmp\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.157782 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.157659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83eae4a6-489b-489a-9f2a-e76ccb890f6f-tls-certs\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.157782 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.157687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pkv2\" (UniqueName: \"kubernetes.io/projected/83eae4a6-489b-489a-9f2a-e76ccb890f6f-kube-api-access-9pkv2\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.159829 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.159802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83eae4a6-489b-489a-9f2a-e76ccb890f6f-tmp\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.160115 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.160094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83eae4a6-489b-489a-9f2a-e76ccb890f6f-tls-certs\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.164979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.164955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pkv2\" (UniqueName: \"kubernetes.io/projected/83eae4a6-489b-489a-9f2a-e76ccb890f6f-kube-api-access-9pkv2\") pod \"kube-auth-proxy-766b79c75b-mfcll\" (UID: \"83eae4a6-489b-489a-9f2a-e76ccb890f6f\") " pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.248262 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.248162    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"
Jul 27 19:33:57.383627 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.383591    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-766b79c75b-mfcll"]
Jul 27 19:33:57.386596 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:33:57.386569    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eae4a6_489b_489a_9f2a_e76ccb890f6f.slice/crio-d041f2dcd775e5f71daf9703f5b5648947d51abab541c0bf5906bb5dc603950a WatchSource:0}: Error finding container d041f2dcd775e5f71daf9703f5b5648947d51abab541c0bf5906bb5dc603950a: Status 404 returned error can't find the container with id d041f2dcd775e5f71daf9703f5b5648947d51abab541c0bf5906bb5dc603950a
Jul 27 19:33:57.953562 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:57.953523    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll" event={"ID":"83eae4a6-489b-489a-9f2a-e76ccb890f6f","Type":"ContainerStarted","Data":"d041f2dcd775e5f71daf9703f5b5648947d51abab541c0bf5906bb5dc603950a"}
Jul 27 19:33:58.039196 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.039156    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"]
Jul 27 19:33:58.043469 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.043446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.045964 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.045846    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 19:33:58.045964 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.045846    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 19:33:58.046143 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.045985    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6ks5w\""
Jul 27 19:33:58.046143 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.045990    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 19:33:58.046143 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.046050    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:33:58.055116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.055047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"]
Jul 27 19:33:58.165699 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.165662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.165901 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.165722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7c2174d-60ee-4be0-af8c-c67279b35f78-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.165901 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.165754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.165901 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.165779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.165901 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.165811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpj6g\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-kube-api-access-dpj6g\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.165901 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.165884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.166158 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.166012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267139 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7c2174d-60ee-4be0-af8c-c67279b35f78-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267139 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267139 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpj6g\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-kube-api-access-dpj6g\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.267961 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.267906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.269876 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.269828    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.269979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.269962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.270034 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.270019    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.270543 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.270527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7c2174d-60ee-4be0-af8c-c67279b35f78-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.275170 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.275117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpj6g\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-kube-api-access-dpj6g\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.275303 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.275283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ffgc2\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.357980 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.357942    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:33:58.523272 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.523249    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"]
Jul 27 19:33:58.526170 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:33:58.526141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c2174d_60ee_4be0_af8c_c67279b35f78.slice/crio-5a6137264b04ae58ed93fdefbf6a5252b7f6c13fe3f702ae390d943a56e0c67f WatchSource:0}: Error finding container 5a6137264b04ae58ed93fdefbf6a5252b7f6c13fe3f702ae390d943a56e0c67f: Status 404 returned error can't find the container with id 5a6137264b04ae58ed93fdefbf6a5252b7f6c13fe3f702ae390d943a56e0c67f
Jul 27 19:33:58.959265 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:58.959216    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2" event={"ID":"d7c2174d-60ee-4be0-af8c-c67279b35f78","Type":"ContainerStarted","Data":"5a6137264b04ae58ed93fdefbf6a5252b7f6c13fe3f702ae390d943a56e0c67f"}
Jul 27 19:33:59.967819 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:33:59.967732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll" event={"ID":"83eae4a6-489b-489a-9f2a-e76ccb890f6f","Type":"ContainerStarted","Data":"423aed64aada4face7904a8776c6daf8186740b41a95a17ab449c9e2ce8cd4e3"}
Jul 27 19:34:00.010581 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:00.010526    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-766b79c75b-mfcll" podStartSLOduration=1.690819955 podStartE2EDuration="4.010503635s" totalImagesPullingTime="2.31968368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:00.007906001 +0000 UTC m=+499.703462119" watchObservedRunningTime="2026-07-27 19:34:00.010503635 +0000 UTC m=+499.706059731"
Jul 27 19:34:01.532212 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:01.532172    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:34:01.532442 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:01.532240    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:34:01.979871 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:01.979814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2" event={"ID":"d7c2174d-60ee-4be0-af8c-c67279b35f78","Type":"ContainerStarted","Data":"9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6"}
Jul 27 19:34:01.980055 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:01.979927    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:34:02.019047 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.018984    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2" podStartSLOduration=1.015449436 podStartE2EDuration="4.018961875s" totalImagesPullingTime="3.003512439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:02.016654058 +0000 UTC m=+501.712210151" watchObservedRunningTime="2026-07-27 19:34:02.018961875 +0000 UTC m=+501.714517971"
Jul 27 19:34:02.849803 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.849769    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"]
Jul 27 19:34:02.853648 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.853623    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:02.856829 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.856806    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7ct6q\""
Jul 27 19:34:02.868185 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.868157    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"]
Jul 27 19:34:02.972836 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.972795    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"]
Jul 27 19:34:02.976140 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.976112    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:02.979192 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.979161    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2xg22\""
Jul 27 19:34:02.979396 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.979377    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 19:34:02.986809 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.986784    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:34:02.992143 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:02.992119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"]
Jul 27 19:34:03.008926 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.008888    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.008964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.008998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.009022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.009042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.009074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009414 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.009176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009414 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.009226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kbxb\" (UniqueName: \"kubernetes.io/projected/04f0ebea-ef00-4298-acf9-cbcede6f2f10-kube-api-access-7kbxb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.009414 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.009281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110405    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xk96\" (UniqueName: \"kubernetes.io/projected/00d079e9-78ff-4565-9812-74771b83966b-kube-api-access-8xk96\") pod \"kserve-controller-manager-d6f4b65b8-lfhc5\" (UID: \"00d079e9-78ff-4565-9812-74771b83966b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.110520 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110520 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00d079e9-78ff-4565-9812-74771b83966b-cert\") pod \"kserve-controller-manager-d6f4b65b8-lfhc5\" (UID: \"00d079e9-78ff-4565-9812-74771b83966b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.110629 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110629 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110629 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110802 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kbxb\" (UniqueName: \"kubernetes.io/projected/04f0ebea-ef00-4298-acf9-cbcede6f2f10-kube-api-access-7kbxb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110802 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110670    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.110993 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.110946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.111128 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.111014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.111128 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.111038    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.112676 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.112656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.112761 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.112724    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.129066 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.129042    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04f0ebea-ef00-4298-acf9-cbcede6f2f10-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.133796 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.133775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kbxb\" (UniqueName: \"kubernetes.io/projected/04f0ebea-ef00-4298-acf9-cbcede6f2f10-kube-api-access-7kbxb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp\" (UID: \"04f0ebea-ef00-4298-acf9-cbcede6f2f10\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.166025 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.165995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:03.211666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.211632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xk96\" (UniqueName: \"kubernetes.io/projected/00d079e9-78ff-4565-9812-74771b83966b-kube-api-access-8xk96\") pod \"kserve-controller-manager-d6f4b65b8-lfhc5\" (UID: \"00d079e9-78ff-4565-9812-74771b83966b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.211666 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.211675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00d079e9-78ff-4565-9812-74771b83966b-cert\") pod \"kserve-controller-manager-d6f4b65b8-lfhc5\" (UID: \"00d079e9-78ff-4565-9812-74771b83966b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.211891 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:34:03.211803    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 19:34:03.211891 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:34:03.211878    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d079e9-78ff-4565-9812-74771b83966b-cert podName:00d079e9-78ff-4565-9812-74771b83966b nodeName:}" failed. No retries permitted until 2026-07-27 19:34:03.711843871 +0000 UTC m=+503.407399943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/00d079e9-78ff-4565-9812-74771b83966b-cert") pod "kserve-controller-manager-d6f4b65b8-lfhc5" (UID: "00d079e9-78ff-4565-9812-74771b83966b") : secret "kserve-webhook-server-cert" not found
Jul 27 19:34:03.229723 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.229665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xk96\" (UniqueName: \"kubernetes.io/projected/00d079e9-78ff-4565-9812-74771b83966b-kube-api-access-8xk96\") pod \"kserve-controller-manager-d6f4b65b8-lfhc5\" (UID: \"00d079e9-78ff-4565-9812-74771b83966b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.325576 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.325451    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"]
Jul 27 19:34:03.328213 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:34:03.328183    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f0ebea_ef00_4298_acf9_cbcede6f2f10.slice/crio-7eb6b6ab46171fa2dbc84364ebb5e83bc06ed0b293db06a96cb018643fe7c79f WatchSource:0}: Error finding container 7eb6b6ab46171fa2dbc84364ebb5e83bc06ed0b293db06a96cb018643fe7c79f: Status 404 returned error can't find the container with id 7eb6b6ab46171fa2dbc84364ebb5e83bc06ed0b293db06a96cb018643fe7c79f
Jul 27 19:34:03.715879 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.715819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00d079e9-78ff-4565-9812-74771b83966b-cert\") pod \"kserve-controller-manager-d6f4b65b8-lfhc5\" (UID: \"00d079e9-78ff-4565-9812-74771b83966b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.718173 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.718146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00d079e9-78ff-4565-9812-74771b83966b-cert\") pod \"kserve-controller-manager-d6f4b65b8-lfhc5\" (UID: \"00d079e9-78ff-4565-9812-74771b83966b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.887434 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.887401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:03.992205 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:03.992168    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp" event={"ID":"04f0ebea-ef00-4298-acf9-cbcede6f2f10","Type":"ContainerStarted","Data":"7eb6b6ab46171fa2dbc84364ebb5e83bc06ed0b293db06a96cb018643fe7c79f"}
Jul 27 19:34:04.023692 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:04.023607    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"]
Jul 27 19:34:04.026371 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:34:04.026344    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d079e9_78ff_4565_9812_74771b83966b.slice/crio-e88ab9dc2b5ba9e43b4e25253bfac6753cd42a385095b0dcdb04e627cca79652 WatchSource:0}: Error finding container e88ab9dc2b5ba9e43b4e25253bfac6753cd42a385095b0dcdb04e627cca79652: Status 404 returned error can't find the container with id e88ab9dc2b5ba9e43b4e25253bfac6753cd42a385095b0dcdb04e627cca79652
Jul 27 19:34:04.998612 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:04.998573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5" event={"ID":"00d079e9-78ff-4565-9812-74771b83966b","Type":"ContainerStarted","Data":"e88ab9dc2b5ba9e43b4e25253bfac6753cd42a385095b0dcdb04e627cca79652"}
Jul 27 19:34:05.447389 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:05.447352    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"]
Jul 27 19:34:05.447604 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:05.447575    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2" podUID="d7c2174d-60ee-4be0-af8c-c67279b35f78" containerName="discovery" containerID="cri-o://9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6" gracePeriod=30
Jul 27 19:34:05.985731 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:05.985696    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-ffgc2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:8080/ready\": dial tcp 10.132.0.54:8080: connect: connection refused" start-of-body=
Jul 27 19:34:05.985910 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:05.985763    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2" podUID="d7c2174d-60ee-4be0-af8c-c67279b35f78" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.54:8080/ready\": dial tcp 10.132.0.54:8080: connect: connection refused"
Jul 27 19:34:06.655991 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.655966    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:34:06.672601 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.672509    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:34:06.672601 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.672568    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:34:06.672601 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.672600    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:34:06.743264 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.743238    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-kubeconfig\") pod \"d7c2174d-60ee-4be0-af8c-c67279b35f78\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") "
Jul 27 19:34:06.743376 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.743313    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpj6g\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-kube-api-access-dpj6g\") pod \"d7c2174d-60ee-4be0-af8c-c67279b35f78\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") "
Jul 27 19:34:06.743376 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.743348    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-ca-configmap\") pod \"d7c2174d-60ee-4be0-af8c-c67279b35f78\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") "
Jul 27 19:34:06.743376 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.743373    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-cacerts\") pod \"d7c2174d-60ee-4be0-af8c-c67279b35f78\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") "
Jul 27 19:34:06.743557 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.743429    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7c2174d-60ee-4be0-af8c-c67279b35f78-local-certs\") pod \"d7c2174d-60ee-4be0-af8c-c67279b35f78\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") "
Jul 27 19:34:06.743557 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.743455    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-dns-cert\") pod \"d7c2174d-60ee-4be0-af8c-c67279b35f78\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") "
Jul 27 19:34:06.743557 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.743483    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-token\") pod \"d7c2174d-60ee-4be0-af8c-c67279b35f78\" (UID: \"d7c2174d-60ee-4be0-af8c-c67279b35f78\") "
Jul 27 19:34:06.744720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.744494    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d7c2174d-60ee-4be0-af8c-c67279b35f78" (UID: "d7c2174d-60ee-4be0-af8c-c67279b35f78"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:34:06.747597 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.747512    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c2174d-60ee-4be0-af8c-c67279b35f78-local-certs" (OuterVolumeSpecName: "local-certs") pod "d7c2174d-60ee-4be0-af8c-c67279b35f78" (UID: "d7c2174d-60ee-4be0-af8c-c67279b35f78"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:34:06.750213 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.750183    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-kube-api-access-dpj6g" (OuterVolumeSpecName: "kube-api-access-dpj6g") pod "d7c2174d-60ee-4be0-af8c-c67279b35f78" (UID: "d7c2174d-60ee-4be0-af8c-c67279b35f78"). InnerVolumeSpecName "kube-api-access-dpj6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:06.750886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.750842    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d7c2174d-60ee-4be0-af8c-c67279b35f78" (UID: "d7c2174d-60ee-4be0-af8c-c67279b35f78"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:34:06.751408 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.751369    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d7c2174d-60ee-4be0-af8c-c67279b35f78" (UID: "d7c2174d-60ee-4be0-af8c-c67279b35f78"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:34:06.751491 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.751434    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-cacerts" (OuterVolumeSpecName: "cacerts") pod "d7c2174d-60ee-4be0-af8c-c67279b35f78" (UID: "d7c2174d-60ee-4be0-af8c-c67279b35f78"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:34:06.751491 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.751454    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-token" (OuterVolumeSpecName: "istio-token") pod "d7c2174d-60ee-4be0-af8c-c67279b35f78" (UID: "d7c2174d-60ee-4be0-af8c-c67279b35f78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:06.845078 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.845045    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:06.845078 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.845071    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-kubeconfig\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:06.845078 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.845080    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpj6g\" (UniqueName: \"kubernetes.io/projected/d7c2174d-60ee-4be0-af8c-c67279b35f78-kube-api-access-dpj6g\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:06.845298 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.845089    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-ca-configmap\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:06.845298 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.845098    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-cacerts\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:06.845298 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.845107    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7c2174d-60ee-4be0-af8c-c67279b35f78-local-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:06.845298 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.845115    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d7c2174d-60ee-4be0-af8c-c67279b35f78-istio-csr-dns-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:06.949401 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.949375    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kq5nd"
Jul 27 19:34:06.952930 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:06.952224    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pzrqd"
Jul 27 19:34:07.012182 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.012149    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7c2174d-60ee-4be0-af8c-c67279b35f78" containerID="9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6" exitCode=0
Jul 27 19:34:07.012321 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.012269    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2" event={"ID":"d7c2174d-60ee-4be0-af8c-c67279b35f78","Type":"ContainerDied","Data":"9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6"}
Jul 27 19:34:07.012321 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.012314    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2" event={"ID":"d7c2174d-60ee-4be0-af8c-c67279b35f78","Type":"ContainerDied","Data":"5a6137264b04ae58ed93fdefbf6a5252b7f6c13fe3f702ae390d943a56e0c67f"}
Jul 27 19:34:07.012424 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.012339    2559 scope.go:117] "RemoveContainer" containerID="9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6"
Jul 27 19:34:07.012563 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.012485    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"
Jul 27 19:34:07.019159 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.018531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5" event={"ID":"00d079e9-78ff-4565-9812-74771b83966b","Type":"ContainerStarted","Data":"ad53add80f20dee25f31ec3735bc18227a8ee49cee7897cf03be9022e026d127"}
Jul 27 19:34:07.019159 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.019084    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:07.021275 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.021248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp" event={"ID":"04f0ebea-ef00-4298-acf9-cbcede6f2f10","Type":"ContainerStarted","Data":"72a7667fc92d8b5614b14ce38e8a6d79a58283dade2b031855f7093336665b8d"}
Jul 27 19:34:07.026884 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.026863    2559 scope.go:117] "RemoveContainer" containerID="9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6"
Jul 27 19:34:07.027188 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:34:07.027156    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6\": container with ID starting with 9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6 not found: ID does not exist" containerID="9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6"
Jul 27 19:34:07.027303 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.027199    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6"} err="failed to get container status \"9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6\": rpc error: code = NotFound desc = could not find container \"9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6\": container with ID starting with 9ac0486cad7ef739907838533059270a16667652cef42bfbaaf4d4b59d1bc5a6 not found: ID does not exist"
Jul 27 19:34:07.038036 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.037984    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5" podStartSLOduration=2.392014026 podStartE2EDuration="5.037964845s" totalImagesPullingTime="2.645950819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:07.035555734 +0000 UTC m=+506.731111828" watchObservedRunningTime="2026-07-27 19:34:07.037964845 +0000 UTC m=+506.733520943"
Jul 27 19:34:07.058379 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.058313    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp" podStartSLOduration=1.71619805 podStartE2EDuration="5.058291448s" totalImagesPullingTime="3.342093398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:07.055690024 +0000 UTC m=+506.751246119" watchObservedRunningTime="2026-07-27 19:34:07.058291448 +0000 UTC m=+506.753847544"
Jul 27 19:34:07.070424 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.070397    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"]
Jul 27 19:34:07.074907 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.074883    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ffgc2"]
Jul 27 19:34:07.167039 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.167009    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:07.168612 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.168586    2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 27 19:34:07.168705 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:07.168643    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp" podUID="04f0ebea-ef00-4298-acf9-cbcede6f2f10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 27 19:34:08.170110 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:08.170082    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:08.942011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:08.941975    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c2174d-60ee-4be0-af8c-c67279b35f78" path="/var/lib/kubelet/pods/d7c2174d-60ee-4be0-af8c-c67279b35f78/volumes"
Jul 27 19:34:09.032516 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:09.032484    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:09.033347 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:09.033327    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp"
Jul 27 19:34:39.037221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:39.037142    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lfhc5"
Jul 27 19:34:52.612702 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.612662    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbfx7"]
Jul 27 19:34:52.613256 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.613000    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7c2174d-60ee-4be0-af8c-c67279b35f78" containerName="discovery"
Jul 27 19:34:52.613256 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.613014    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c2174d-60ee-4be0-af8c-c67279b35f78" containerName="discovery"
Jul 27 19:34:52.613256 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.613113    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7c2174d-60ee-4be0-af8c-c67279b35f78" containerName="discovery"
Jul 27 19:34:52.621443 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.621416    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7"
Jul 27 19:34:52.623746 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.623716    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vc5xh\""
Jul 27 19:34:52.625029 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.624941    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbfx7"]
Jul 27 19:34:52.625396 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.625377    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:34:52.625748 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.625625    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:34:52.748338 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.748301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvw4\" (UniqueName: \"kubernetes.io/projected/8a5108d4-957c-4478-9730-2f61d2d07347-kube-api-access-6gvw4\") pod \"kuadrant-operator-catalog-sbfx7\" (UID: \"8a5108d4-957c-4478-9730-2f61d2d07347\") " pod="kuadrant-system/kuadrant-operator-catalog-sbfx7"
Jul 27 19:34:52.849316 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.849278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvw4\" (UniqueName: \"kubernetes.io/projected/8a5108d4-957c-4478-9730-2f61d2d07347-kube-api-access-6gvw4\") pod \"kuadrant-operator-catalog-sbfx7\" (UID: \"8a5108d4-957c-4478-9730-2f61d2d07347\") " pod="kuadrant-system/kuadrant-operator-catalog-sbfx7"
Jul 27 19:34:52.856233 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.856203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvw4\" (UniqueName: \"kubernetes.io/projected/8a5108d4-957c-4478-9730-2f61d2d07347-kube-api-access-6gvw4\") pod \"kuadrant-operator-catalog-sbfx7\" (UID: \"8a5108d4-957c-4478-9730-2f61d2d07347\") " pod="kuadrant-system/kuadrant-operator-catalog-sbfx7"
Jul 27 19:34:52.933359 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.933326    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7"
Jul 27 19:34:52.987516 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:52.987478    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbfx7"]
Jul 27 19:34:53.066559 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.066534    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbfx7"]
Jul 27 19:34:53.069038 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:34:53.069010    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5108d4_957c_4478_9730_2f61d2d07347.slice/crio-8989c2957ecf4be3fedb4f68478773145236f9dddcaf4e12c3d7acf52e2a36ea WatchSource:0}: Error finding container 8989c2957ecf4be3fedb4f68478773145236f9dddcaf4e12c3d7acf52e2a36ea: Status 404 returned error can't find the container with id 8989c2957ecf4be3fedb4f68478773145236f9dddcaf4e12c3d7acf52e2a36ea
Jul 27 19:34:53.189881 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.189792    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fpb2q"]
Jul 27 19:34:53.192745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.192730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:34:53.200993 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.200974    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fpb2q"]
Jul 27 19:34:53.217985 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.217958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7" event={"ID":"8a5108d4-957c-4478-9730-2f61d2d07347","Type":"ContainerStarted","Data":"8989c2957ecf4be3fedb4f68478773145236f9dddcaf4e12c3d7acf52e2a36ea"}
Jul 27 19:34:53.353999 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.353958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6twvn\" (UniqueName: \"kubernetes.io/projected/1acd54de-6dd2-4071-aed6-fa5ab839ee7e-kube-api-access-6twvn\") pod \"kuadrant-operator-catalog-fpb2q\" (UID: \"1acd54de-6dd2-4071-aed6-fa5ab839ee7e\") " pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:34:53.455443 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.455357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6twvn\" (UniqueName: \"kubernetes.io/projected/1acd54de-6dd2-4071-aed6-fa5ab839ee7e-kube-api-access-6twvn\") pod \"kuadrant-operator-catalog-fpb2q\" (UID: \"1acd54de-6dd2-4071-aed6-fa5ab839ee7e\") " pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:34:53.462367 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.462334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6twvn\" (UniqueName: \"kubernetes.io/projected/1acd54de-6dd2-4071-aed6-fa5ab839ee7e-kube-api-access-6twvn\") pod \"kuadrant-operator-catalog-fpb2q\" (UID: \"1acd54de-6dd2-4071-aed6-fa5ab839ee7e\") " pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:34:53.502440 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.502409    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:34:53.632111 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:53.632081    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fpb2q"]
Jul 27 19:34:53.635406 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:34:53.635378    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acd54de_6dd2_4071_aed6_fa5ab839ee7e.slice/crio-d4fb564c62ce6af0ff3cad5017563b9b6eb54fc63dad38be4ddb0ca9eb14d66e WatchSource:0}: Error finding container d4fb564c62ce6af0ff3cad5017563b9b6eb54fc63dad38be4ddb0ca9eb14d66e: Status 404 returned error can't find the container with id d4fb564c62ce6af0ff3cad5017563b9b6eb54fc63dad38be4ddb0ca9eb14d66e
Jul 27 19:34:54.224315 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:54.224281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q" event={"ID":"1acd54de-6dd2-4071-aed6-fa5ab839ee7e","Type":"ContainerStarted","Data":"d4fb564c62ce6af0ff3cad5017563b9b6eb54fc63dad38be4ddb0ca9eb14d66e"}
Jul 27 19:34:56.233971 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.233936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7" event={"ID":"8a5108d4-957c-4478-9730-2f61d2d07347","Type":"ContainerStarted","Data":"9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9"}
Jul 27 19:34:56.234435 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.234042    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7" podUID="8a5108d4-957c-4478-9730-2f61d2d07347" containerName="registry-server" containerID="cri-o://9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9" gracePeriod=2
Jul 27 19:34:56.235535 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.235512    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q" event={"ID":"1acd54de-6dd2-4071-aed6-fa5ab839ee7e","Type":"ContainerStarted","Data":"7e3b96a51b88d1aa982d13d10a327be3ddae2783e528805d0a02468caa1316f5"}
Jul 27 19:34:56.248614 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.248559    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7" podStartSLOduration=2.136486389 podStartE2EDuration="4.248546383s" totalImagesPullingTime="2.112059994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:56.247620097 +0000 UTC m=+555.943176191" watchObservedRunningTime="2026-07-27 19:34:56.248546383 +0000 UTC m=+555.944102476"
Jul 27 19:34:56.261408 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.261366    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q" podStartSLOduration=1.712591016 podStartE2EDuration="3.26135411s" totalImagesPullingTime="1.548763094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:56.261119145 +0000 UTC m=+555.956675239" watchObservedRunningTime="2026-07-27 19:34:56.26135411 +0000 UTC m=+555.956910203"
Jul 27 19:34:56.486342 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.486264    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7"
Jul 27 19:34:56.582030 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.582000    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gvw4\" (UniqueName: \"kubernetes.io/projected/8a5108d4-957c-4478-9730-2f61d2d07347-kube-api-access-6gvw4\") pod \"8a5108d4-957c-4478-9730-2f61d2d07347\" (UID: \"8a5108d4-957c-4478-9730-2f61d2d07347\") "
Jul 27 19:34:56.584203 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.584165    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5108d4-957c-4478-9730-2f61d2d07347-kube-api-access-6gvw4" (OuterVolumeSpecName: "kube-api-access-6gvw4") pod "8a5108d4-957c-4478-9730-2f61d2d07347" (UID: "8a5108d4-957c-4478-9730-2f61d2d07347"). InnerVolumeSpecName "kube-api-access-6gvw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:34:56.682777 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:56.682737    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gvw4\" (UniqueName: \"kubernetes.io/projected/8a5108d4-957c-4478-9730-2f61d2d07347-kube-api-access-6gvw4\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:34:57.241011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.240929    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a5108d4-957c-4478-9730-2f61d2d07347" containerID="9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9" exitCode=0
Jul 27 19:34:57.241011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.240989    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7"
Jul 27 19:34:57.241444 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.241015    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7" event={"ID":"8a5108d4-957c-4478-9730-2f61d2d07347","Type":"ContainerDied","Data":"9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9"}
Jul 27 19:34:57.241444 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.241065    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sbfx7" event={"ID":"8a5108d4-957c-4478-9730-2f61d2d07347","Type":"ContainerDied","Data":"8989c2957ecf4be3fedb4f68478773145236f9dddcaf4e12c3d7acf52e2a36ea"}
Jul 27 19:34:57.241444 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.241085    2559 scope.go:117] "RemoveContainer" containerID="9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9"
Jul 27 19:34:57.249796 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.249780    2559 scope.go:117] "RemoveContainer" containerID="9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9"
Jul 27 19:34:57.250053 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:34:57.250035    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9\": container with ID starting with 9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9 not found: ID does not exist" containerID="9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9"
Jul 27 19:34:57.250113 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.250060    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9"} err="failed to get container status \"9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9\": rpc error: code = NotFound desc = could not find container \"9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9\": container with ID starting with 9a6a5bba3b9d294439fe0dbf0975268a16266ea0ae558aea31ef84254f135df9 not found: ID does not exist"
Jul 27 19:34:57.255951 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.255932    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbfx7"]
Jul 27 19:34:57.261079 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:57.261057    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sbfx7"]
Jul 27 19:34:58.941369 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:34:58.941337    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5108d4-957c-4478-9730-2f61d2d07347" path="/var/lib/kubelet/pods/8a5108d4-957c-4478-9730-2f61d2d07347/volumes"
Jul 27 19:35:03.502961 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:03.502911    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:35:03.503355 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:03.502989    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:35:03.524129 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:03.524092    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:35:04.290914 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:04.290887    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fpb2q"
Jul 27 19:35:18.338834 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.338795    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"]
Jul 27 19:35:18.339396 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.339296    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5108d4-957c-4478-9730-2f61d2d07347" containerName="registry-server"
Jul 27 19:35:18.339396 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.339316    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5108d4-957c-4478-9730-2f61d2d07347" containerName="registry-server"
Jul 27 19:35:18.339518 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.339413    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5108d4-957c-4478-9730-2f61d2d07347" containerName="registry-server"
Jul 27 19:35:18.346591 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.346566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"
Jul 27 19:35:18.348041 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.348005    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"]
Jul 27 19:35:18.348784 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.348760    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 19:35:18.348784 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.348775    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sqjhh\""
Jul 27 19:35:18.375904 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.375877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j98gk\" (UniqueName: \"kubernetes.io/projected/560d86be-48f3-4097-8410-0f8b3f77aeeb-kube-api-access-j98gk\") pod \"dns-operator-controller-manager-864dd78c4c-vtnl2\" (UID: \"560d86be-48f3-4097-8410-0f8b3f77aeeb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"
Jul 27 19:35:18.477217 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.477180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j98gk\" (UniqueName: \"kubernetes.io/projected/560d86be-48f3-4097-8410-0f8b3f77aeeb-kube-api-access-j98gk\") pod \"dns-operator-controller-manager-864dd78c4c-vtnl2\" (UID: \"560d86be-48f3-4097-8410-0f8b3f77aeeb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"
Jul 27 19:35:18.488388 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.488356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j98gk\" (UniqueName: \"kubernetes.io/projected/560d86be-48f3-4097-8410-0f8b3f77aeeb-kube-api-access-j98gk\") pod \"dns-operator-controller-manager-864dd78c4c-vtnl2\" (UID: \"560d86be-48f3-4097-8410-0f8b3f77aeeb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"
Jul 27 19:35:18.657295 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.657213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"
Jul 27 19:35:18.792787 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:18.792737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"]
Jul 27 19:35:18.795136 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:35:18.795105    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560d86be_48f3_4097_8410_0f8b3f77aeeb.slice/crio-cbee0cafdf4eea2864d795a0c04dc7c3a8d2ac7f04d7a7fc059e7b721971fc3c WatchSource:0}: Error finding container cbee0cafdf4eea2864d795a0c04dc7c3a8d2ac7f04d7a7fc059e7b721971fc3c: Status 404 returned error can't find the container with id cbee0cafdf4eea2864d795a0c04dc7c3a8d2ac7f04d7a7fc059e7b721971fc3c
Jul 27 19:35:19.343919 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:19.343887    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2" event={"ID":"560d86be-48f3-4097-8410-0f8b3f77aeeb","Type":"ContainerStarted","Data":"cbee0cafdf4eea2864d795a0c04dc7c3a8d2ac7f04d7a7fc059e7b721971fc3c"}
Jul 27 19:35:21.355497 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:21.355411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2" event={"ID":"560d86be-48f3-4097-8410-0f8b3f77aeeb","Type":"ContainerStarted","Data":"1796cbb86d1df140047acad35b50135ed365409be322130b6953d18ba474ea46"}
Jul 27 19:35:21.355497 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:21.355478    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"
Jul 27 19:35:21.372134 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:21.372082    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2" podStartSLOduration=1.074340715 podStartE2EDuration="3.372066096s" totalImagesPullingTime="2.297725381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:21.370406278 +0000 UTC m=+581.065962375" watchObservedRunningTime="2026-07-27 19:35:21.372066096 +0000 UTC m=+581.067622190"
Jul 27 19:35:21.973099 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:21.973057    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"]
Jul 27 19:35:21.976466 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:21.976442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:21.978834 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:21.978811    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z929q\""
Jul 27 19:35:21.985622 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:21.985601    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"]
Jul 27 19:35:22.012579 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:22.008624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t897n\" (UniqueName: \"kubernetes.io/projected/1a18c3fb-8ae7-48ef-b223-11f84a714c32-kube-api-access-t897n\") pod \"limitador-operator-controller-manager-859d7b78bd-4srjv\" (UID: \"1a18c3fb-8ae7-48ef-b223-11f84a714c32\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:22.109744 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:22.109704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t897n\" (UniqueName: \"kubernetes.io/projected/1a18c3fb-8ae7-48ef-b223-11f84a714c32-kube-api-access-t897n\") pod \"limitador-operator-controller-manager-859d7b78bd-4srjv\" (UID: \"1a18c3fb-8ae7-48ef-b223-11f84a714c32\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:22.121314 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:22.121279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t897n\" (UniqueName: \"kubernetes.io/projected/1a18c3fb-8ae7-48ef-b223-11f84a714c32-kube-api-access-t897n\") pod \"limitador-operator-controller-manager-859d7b78bd-4srjv\" (UID: \"1a18c3fb-8ae7-48ef-b223-11f84a714c32\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:22.286987 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:22.286898    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:22.419231 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:22.419208    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"]
Jul 27 19:35:22.421864 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:35:22.421826    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a18c3fb_8ae7_48ef_b223_11f84a714c32.slice/crio-3cff9c4451c07b81d3744241f8363533ee2112353de29513915ca3ad4fca86d6 WatchSource:0}: Error finding container 3cff9c4451c07b81d3744241f8363533ee2112353de29513915ca3ad4fca86d6: Status 404 returned error can't find the container with id 3cff9c4451c07b81d3744241f8363533ee2112353de29513915ca3ad4fca86d6
Jul 27 19:35:23.368833 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:23.368799    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv" event={"ID":"1a18c3fb-8ae7-48ef-b223-11f84a714c32","Type":"ContainerStarted","Data":"3cff9c4451c07b81d3744241f8363533ee2112353de29513915ca3ad4fca86d6"}
Jul 27 19:35:24.375281 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:24.375242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv" event={"ID":"1a18c3fb-8ae7-48ef-b223-11f84a714c32","Type":"ContainerStarted","Data":"77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a"}
Jul 27 19:35:24.375736 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:24.375352    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:24.394498 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:24.394454    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv" podStartSLOduration=1.954601705 podStartE2EDuration="3.394436407s" totalImagesPullingTime="1.439834702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:24.394246495 +0000 UTC m=+584.089802605" watchObservedRunningTime="2026-07-27 19:35:24.394436407 +0000 UTC m=+584.089992495"
Jul 27 19:35:27.234111 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.234076    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"]
Jul 27 19:35:27.237640 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.237615    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.240049 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.240023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4pxj2\""
Jul 27 19:35:27.251393 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.251369    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"]
Jul 27 19:35:27.356350 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.356311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swlhq\" (UniqueName: \"kubernetes.io/projected/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-kube-api-access-swlhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.356536 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.356369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.457961 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.457927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swlhq\" (UniqueName: \"kubernetes.io/projected/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-kube-api-access-swlhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.458138 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.458013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.458452 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.458429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.480470 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.480443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swlhq\" (UniqueName: \"kubernetes.io/projected/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-kube-api-access-swlhq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.548499 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.548409    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:27.688135 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:27.688109    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"]
Jul 27 19:35:27.690984 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:35:27.690954    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8fb757_dbb6_465a_b18c_1c3e0684e45f.slice/crio-54136fa50b45637231305ef15fcb8ad4a65542ec73264ccce99d386b883fc71b WatchSource:0}: Error finding container 54136fa50b45637231305ef15fcb8ad4a65542ec73264ccce99d386b883fc71b: Status 404 returned error can't find the container with id 54136fa50b45637231305ef15fcb8ad4a65542ec73264ccce99d386b883fc71b
Jul 27 19:35:28.395306 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:28.395275    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh" event={"ID":"9f8fb757-dbb6-465a-b18c-1c3e0684e45f","Type":"ContainerStarted","Data":"54136fa50b45637231305ef15fcb8ad4a65542ec73264ccce99d386b883fc71b"}
Jul 27 19:35:30.437992 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.437954    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"]
Jul 27 19:35:30.441454 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.441433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"
Jul 27 19:35:30.443990 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.443968    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gtsch\""
Jul 27 19:35:30.453917 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.453893    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"]
Jul 27 19:35:30.589386 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.589352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nfdn\" (UniqueName: \"kubernetes.io/projected/f8a1ee52-34b7-477b-b655-f924e48813f5-kube-api-access-7nfdn\") pod \"authorino-operator-75cc8d5cb7-5msfs\" (UID: \"f8a1ee52-34b7-477b-b655-f924e48813f5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"
Jul 27 19:35:30.689846 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.689749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nfdn\" (UniqueName: \"kubernetes.io/projected/f8a1ee52-34b7-477b-b655-f924e48813f5-kube-api-access-7nfdn\") pod \"authorino-operator-75cc8d5cb7-5msfs\" (UID: \"f8a1ee52-34b7-477b-b655-f924e48813f5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"
Jul 27 19:35:30.698169 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.698138    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nfdn\" (UniqueName: \"kubernetes.io/projected/f8a1ee52-34b7-477b-b655-f924e48813f5-kube-api-access-7nfdn\") pod \"authorino-operator-75cc8d5cb7-5msfs\" (UID: \"f8a1ee52-34b7-477b-b655-f924e48813f5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"
Jul 27 19:35:30.754221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.754188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"
Jul 27 19:35:30.886440 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:30.886415    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"]
Jul 27 19:35:30.888934 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:35:30.888906    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a1ee52_34b7_477b_b655_f924e48813f5.slice/crio-5a333dd83e58fffd4f000851a3f40638a29a0a884174408fe130b762faebad0e WatchSource:0}: Error finding container 5a333dd83e58fffd4f000851a3f40638a29a0a884174408fe130b762faebad0e: Status 404 returned error can't find the container with id 5a333dd83e58fffd4f000851a3f40638a29a0a884174408fe130b762faebad0e
Jul 27 19:35:31.412403 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:31.412370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs" event={"ID":"f8a1ee52-34b7-477b-b655-f924e48813f5","Type":"ContainerStarted","Data":"5a333dd83e58fffd4f000851a3f40638a29a0a884174408fe130b762faebad0e"}
Jul 27 19:35:32.363293 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:32.363262    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vtnl2"
Jul 27 19:35:32.422160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:32.422126    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh" event={"ID":"9f8fb757-dbb6-465a-b18c-1c3e0684e45f","Type":"ContainerStarted","Data":"f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a"}
Jul 27 19:35:32.422451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:32.422422    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:32.441421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:32.441367    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh" podStartSLOduration=0.930450359 podStartE2EDuration="5.441348532s" totalImagesPullingTime="4.510898173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:32.44062974 +0000 UTC m=+592.136185837" watchObservedRunningTime="2026-07-27 19:35:32.441348532 +0000 UTC m=+592.136904629"
Jul 27 19:35:34.436228 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:34.436188    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs" event={"ID":"f8a1ee52-34b7-477b-b655-f924e48813f5","Type":"ContainerStarted","Data":"82bf04c5214df03596e7aa673bc652e2562c8932e51fcc67051fa438611c955a"}
Jul 27 19:35:34.436650 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:34.436249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"
Jul 27 19:35:34.463224 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:34.463181    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs" podStartSLOduration=1.4344812120000001 podStartE2EDuration="4.463166108s" totalImagesPullingTime="3.028684896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:34.461467351 +0000 UTC m=+594.157023445" watchObservedRunningTime="2026-07-27 19:35:34.463166108 +0000 UTC m=+594.158722201"
Jul 27 19:35:35.045774 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.045738    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"]
Jul 27 19:35:35.048583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.048561    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.050802 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.050752    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 19:35:35.050956 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.050942    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pc9j\""
Jul 27 19:35:35.051045 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.051007    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 19:35:35.056652 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.056630    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"]
Jul 27 19:35:35.132067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.132034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81501b35-ed01-426c-ac9d-a871032d348e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.132067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.132069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnqt\" (UniqueName: \"kubernetes.io/projected/81501b35-ed01-426c-ac9d-a871032d348e-kube-api-access-zjnqt\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.132281 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.132115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81501b35-ed01-426c-ac9d-a871032d348e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.233154 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.233116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81501b35-ed01-426c-ac9d-a871032d348e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.233326 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.233204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81501b35-ed01-426c-ac9d-a871032d348e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.233326 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.233237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnqt\" (UniqueName: \"kubernetes.io/projected/81501b35-ed01-426c-ac9d-a871032d348e-kube-api-access-zjnqt\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.233413 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:35.233349    2559 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 27 19:35:35.233446 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:35.233418    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81501b35-ed01-426c-ac9d-a871032d348e-plugin-serving-cert podName:81501b35-ed01-426c-ac9d-a871032d348e nodeName:}" failed. No retries permitted until 2026-07-27 19:35:35.733401241 +0000 UTC m=+595.428957317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/81501b35-ed01-426c-ac9d-a871032d348e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6ht5d" (UID: "81501b35-ed01-426c-ac9d-a871032d348e") : secret "plugin-serving-cert" not found
Jul 27 19:35:35.233906 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.233887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/81501b35-ed01-426c-ac9d-a871032d348e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.241483 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.241459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnqt\" (UniqueName: \"kubernetes.io/projected/81501b35-ed01-426c-ac9d-a871032d348e-kube-api-access-zjnqt\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.382309 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.382229    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:35.738446 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.738416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81501b35-ed01-426c-ac9d-a871032d348e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.740751 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.740731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/81501b35-ed01-426c-ac9d-a871032d348e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6ht5d\" (UID: \"81501b35-ed01-426c-ac9d-a871032d348e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:35.958571 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:35.958540    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"
Jul 27 19:35:36.092755 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:36.092724    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d"]
Jul 27 19:35:36.096334 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:35:36.096311    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81501b35_ed01_426c_ac9d_a871032d348e.slice/crio-ab3696c98a9d009a4b739ca36f81994d67b1855752384a5e24dad832b2547f5f WatchSource:0}: Error finding container ab3696c98a9d009a4b739ca36f81994d67b1855752384a5e24dad832b2547f5f: Status 404 returned error can't find the container with id ab3696c98a9d009a4b739ca36f81994d67b1855752384a5e24dad832b2547f5f
Jul 27 19:35:36.447782 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:36.447749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d" event={"ID":"81501b35-ed01-426c-ac9d-a871032d348e","Type":"ContainerStarted","Data":"ab3696c98a9d009a4b739ca36f81994d67b1855752384a5e24dad832b2547f5f"}
Jul 27 19:35:40.776448 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:40.776416    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:35:40.777314 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:40.777293    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:35:40.781711 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:40.781690    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:35:40.782869 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:40.782833    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:35:43.431528 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:43.431496    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:44.561979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.561945    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"]
Jul 27 19:35:44.572053 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.572029    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:44.590777 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.590751    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"]
Jul 27 19:35:44.715446 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.715404    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"]
Jul 27 19:35:44.715733 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:44.715709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-58lkd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd" podUID="5fe36317-dfe7-465e-95ba-793c0f1b43da"
Jul 27 19:35:44.730501 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.730464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58lkd\" (UniqueName: \"kubernetes.io/projected/5fe36317-dfe7-465e-95ba-793c0f1b43da-kube-api-access-58lkd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:44.730676 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.730514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe36317-dfe7-465e-95ba-793c0f1b43da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:44.762552 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.762519    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"]
Jul 27 19:35:44.765331 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.765310    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:44.778625 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.778601    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"]
Jul 27 19:35:44.831353 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.831282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58lkd\" (UniqueName: \"kubernetes.io/projected/5fe36317-dfe7-465e-95ba-793c0f1b43da-kube-api-access-58lkd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:44.831353 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.831317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe36317-dfe7-465e-95ba-793c0f1b43da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:44.831716 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.831697    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe36317-dfe7-465e-95ba-793c0f1b43da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:44.840156 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.840123    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58lkd\" (UniqueName: \"kubernetes.io/projected/5fe36317-dfe7-465e-95ba-793c0f1b43da-kube-api-access-58lkd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:44.932429 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.932233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/693ef560-c44c-4d67-b4da-5a908f3eb03b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:44.932429 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:44.932302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fg5j\" (UniqueName: \"kubernetes.io/projected/693ef560-c44c-4d67-b4da-5a908f3eb03b-kube-api-access-7fg5j\") pod \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:45.032995 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.032962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/693ef560-c44c-4d67-b4da-5a908f3eb03b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:45.033154 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.033007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fg5j\" (UniqueName: \"kubernetes.io/projected/693ef560-c44c-4d67-b4da-5a908f3eb03b-kube-api-access-7fg5j\") pod \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:45.033385 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.033363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/693ef560-c44c-4d67-b4da-5a908f3eb03b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:45.061866 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.061820    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fg5j\" (UniqueName: \"kubernetes.io/projected/693ef560-c44c-4d67-b4da-5a908f3eb03b-kube-api-access-7fg5j\") pod \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:45.077544 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.077505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:45.129223 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.129195    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"]
Jul 27 19:35:45.136058 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.136030    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"]
Jul 27 19:35:45.143770 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.143743    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"]
Jul 27 19:35:45.154099 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.152427    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"]
Jul 27 19:35:45.157818 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.157218    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"]
Jul 27 19:35:45.163427 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.163390    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"]
Jul 27 19:35:45.163764 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.163499    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.163764 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.163639    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" containerName="manager" containerID="cri-o://f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a" gracePeriod=2
Jul 27 19:35:45.170437 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.170403    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"]
Jul 27 19:35:45.175505 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.174774    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"]
Jul 27 19:35:45.186724 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.186700    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"]
Jul 27 19:35:45.188053 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.188016    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" containerName="manager" containerID="cri-o://77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a" gracePeriod=2
Jul 27 19:35:45.189496 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.189480    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"]
Jul 27 19:35:45.190090 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.190074    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" containerName="manager"
Jul 27 19:35:45.190192 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.190182    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" containerName="manager"
Jul 27 19:35:45.190351 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.190342    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" containerName="manager"
Jul 27 19:35:45.192998 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.192983    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.221216 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.220944    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"]
Jul 27 19:35:45.226147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.226119    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"]
Jul 27 19:35:45.240092 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.240057    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:45.241842 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.241803    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:45.335549 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.335462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h476\" (UniqueName: \"kubernetes.io/projected/86ad0911-64de-429e-aa54-1aa5e6986332-kube-api-access-5h476\") pod \"kuadrant-operator-controller-manager-55467d9f7-7v5z9\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.335549 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.335537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ad0911-64de-429e-aa54-1aa5e6986332-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7v5z9\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.335765 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.335567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjnqw\" (UniqueName: \"kubernetes.io/projected/c977d8d3-e25c-4629-b24c-2b7872e6b363-kube-api-access-fjnqw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4qzq\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.335765 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.335674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c977d8d3-e25c-4629-b24c-2b7872e6b363-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4qzq\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.437148 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.437109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h476\" (UniqueName: \"kubernetes.io/projected/86ad0911-64de-429e-aa54-1aa5e6986332-kube-api-access-5h476\") pod \"kuadrant-operator-controller-manager-55467d9f7-7v5z9\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.437333 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.437178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ad0911-64de-429e-aa54-1aa5e6986332-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7v5z9\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.437333 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.437209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjnqw\" (UniqueName: \"kubernetes.io/projected/c977d8d3-e25c-4629-b24c-2b7872e6b363-kube-api-access-fjnqw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4qzq\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.437333 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.437274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c977d8d3-e25c-4629-b24c-2b7872e6b363-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4qzq\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.437637 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.437614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c977d8d3-e25c-4629-b24c-2b7872e6b363-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4qzq\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.437710 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.437669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ad0911-64de-429e-aa54-1aa5e6986332-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7v5z9\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.444129 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.444108    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5msfs"
Jul 27 19:35:45.445783 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.445762    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjnqw\" (UniqueName: \"kubernetes.io/projected/c977d8d3-e25c-4629-b24c-2b7872e6b363-kube-api-access-fjnqw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q4qzq\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.446103 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.446082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h476\" (UniqueName: \"kubernetes.io/projected/86ad0911-64de-429e-aa54-1aa5e6986332-kube-api-access-5h476\") pod \"kuadrant-operator-controller-manager-55467d9f7-7v5z9\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.446103 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.446084    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:45.467986 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.467953    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:45.484257 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.484214    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:45.501009 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.500985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:45.503110 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.503071    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:45.504752 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.504718    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="5fe36317-dfe7-465e-95ba-793c0f1b43da" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:45.506442 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.506415    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:45.509742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.509721    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:45.511698 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.511673    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="5fe36317-dfe7-465e-95ba-793c0f1b43da" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:45.513368 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.513345    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:45.515042 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:45.515017    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:45.571943 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.571913    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:45.639117 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.639036    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe36317-dfe7-465e-95ba-793c0f1b43da-extensions-socket-volume\") pod \"5fe36317-dfe7-465e-95ba-793c0f1b43da\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") "
Jul 27 19:35:45.639117 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.639082    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58lkd\" (UniqueName: \"kubernetes.io/projected/5fe36317-dfe7-465e-95ba-793c0f1b43da-kube-api-access-58lkd\") pod \"5fe36317-dfe7-465e-95ba-793c0f1b43da\" (UID: \"5fe36317-dfe7-465e-95ba-793c0f1b43da\") "
Jul 27 19:35:45.639377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.639348    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe36317-dfe7-465e-95ba-793c0f1b43da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5fe36317-dfe7-465e-95ba-793c0f1b43da" (UID: "5fe36317-dfe7-465e-95ba-793c0f1b43da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:45.641459 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.641433    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe36317-dfe7-465e-95ba-793c0f1b43da-kube-api-access-58lkd" (OuterVolumeSpecName: "kube-api-access-58lkd") pod "5fe36317-dfe7-465e-95ba-793c0f1b43da" (UID: "5fe36317-dfe7-465e-95ba-793c0f1b43da"). InnerVolumeSpecName "kube-api-access-58lkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:45.740215 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.740176    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fe36317-dfe7-465e-95ba-793c0f1b43da-extensions-socket-volume\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:35:45.740215 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:45.740211    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58lkd\" (UniqueName: \"kubernetes.io/projected/5fe36317-dfe7-465e-95ba-793c0f1b43da-kube-api-access-58lkd\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:35:46.381159 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:46.381117    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.60:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 19:35:46.506456 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:46.506427    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:46.508975 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:46.508807    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="5fe36317-dfe7-465e-95ba-793c0f1b43da" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:46.510944 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:46.510913    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:46.512829 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:46.512802    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:46.516326 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:46.516299    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-4zxqd\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="5fe36317-dfe7-465e-95ba-793c0f1b43da" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4zxqd"
Jul 27 19:35:46.518070 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:46.518047    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:46.519813 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:46.519792    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:46.942130 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:46.942094    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe36317-dfe7-465e-95ba-793c0f1b43da" path="/var/lib/kubelet/pods/5fe36317-dfe7-465e-95ba-793c0f1b43da/volumes"
Jul 27 19:35:56.943689 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:56.943663    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:56.951048 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:56.951012    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:56.952736 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:56.952712    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:56.954601 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:56.954571    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:56.974272 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:56.974245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"]
Jul 27 19:35:56.975735 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:35:56.975709    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc977d8d3_e25c_4629_b24c_2b7872e6b363.slice/crio-cb021330c4b36cc98824e0dc964452e50a3bef91fe76c681c2536aa917ac9286 WatchSource:0}: Error finding container cb021330c4b36cc98824e0dc964452e50a3bef91fe76c681c2536aa917ac9286: Status 404 returned error can't find the container with id cb021330c4b36cc98824e0dc964452e50a3bef91fe76c681c2536aa917ac9286
Jul 27 19:35:57.001336 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.001312    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"]
Jul 27 19:35:57.003975 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:35:57.003950    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ad0911_64de_429e_aa54_1aa5e6986332.slice/crio-9ff2e2ae69a4a0c425fd5791a33cb781ddbec5d64cc96a3c0eb51a7626acb1ef WatchSource:0}: Error finding container 9ff2e2ae69a4a0c425fd5791a33cb781ddbec5d64cc96a3c0eb51a7626acb1ef: Status 404 returned error can't find the container with id 9ff2e2ae69a4a0c425fd5791a33cb781ddbec5d64cc96a3c0eb51a7626acb1ef
Jul 27 19:35:57.053122 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.053101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t897n\" (UniqueName: \"kubernetes.io/projected/1a18c3fb-8ae7-48ef-b223-11f84a714c32-kube-api-access-t897n\") pod \"1a18c3fb-8ae7-48ef-b223-11f84a714c32\" (UID: \"1a18c3fb-8ae7-48ef-b223-11f84a714c32\") "
Jul 27 19:35:57.053219 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.053138    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-extensions-socket-volume\") pod \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") "
Jul 27 19:35:57.053219 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.053177    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swlhq\" (UniqueName: \"kubernetes.io/projected/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-kube-api-access-swlhq\") pod \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\" (UID: \"9f8fb757-dbb6-465a-b18c-1c3e0684e45f\") "
Jul 27 19:35:57.053570 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.053539    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f8fb757-dbb6-465a-b18c-1c3e0684e45f" (UID: "9f8fb757-dbb6-465a-b18c-1c3e0684e45f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:57.055159 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.055135    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a18c3fb-8ae7-48ef-b223-11f84a714c32-kube-api-access-t897n" (OuterVolumeSpecName: "kube-api-access-t897n") pod "1a18c3fb-8ae7-48ef-b223-11f84a714c32" (UID: "1a18c3fb-8ae7-48ef-b223-11f84a714c32"). InnerVolumeSpecName "kube-api-access-t897n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:57.055331 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.055314    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-kube-api-access-swlhq" (OuterVolumeSpecName: "kube-api-access-swlhq") pod "9f8fb757-dbb6-465a-b18c-1c3e0684e45f" (UID: "9f8fb757-dbb6-465a-b18c-1c3e0684e45f"). InnerVolumeSpecName "kube-api-access-swlhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:57.154062 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.154027    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t897n\" (UniqueName: \"kubernetes.io/projected/1a18c3fb-8ae7-48ef-b223-11f84a714c32-kube-api-access-t897n\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:35:57.154062 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.154055    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-extensions-socket-volume\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:35:57.154062 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.154064    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swlhq\" (UniqueName: \"kubernetes.io/projected/9f8fb757-dbb6-465a-b18c-1c3e0684e45f-kube-api-access-swlhq\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:35:57.567419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.567384    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d" event={"ID":"81501b35-ed01-426c-ac9d-a871032d348e","Type":"ContainerStarted","Data":"30c984f06355488244d8779c6fa3893ed4d7e17a15d5ce16fd091b0c547c8902"}
Jul 27 19:35:57.568680 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.568650    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" containerID="f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a" exitCode=0
Jul 27 19:35:57.568810 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.568687    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:57.568810 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.568739    2559 scope.go:117] "RemoveContainer" containerID="f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a"
Jul 27 19:35:57.570037 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.570017    2559 generic.go:356] "Generic (PLEG): container finished" podID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" containerID="77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a" exitCode=0
Jul 27 19:35:57.570153 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.570110    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:57.572041 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.572016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq" event={"ID":"c977d8d3-e25c-4629-b24c-2b7872e6b363","Type":"ContainerStarted","Data":"6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c"}
Jul 27 19:35:57.572147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.572066    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:35:57.572147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.572089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq" event={"ID":"c977d8d3-e25c-4629-b24c-2b7872e6b363","Type":"ContainerStarted","Data":"cb021330c4b36cc98824e0dc964452e50a3bef91fe76c681c2536aa917ac9286"}
Jul 27 19:35:57.573664 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.573644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9" event={"ID":"86ad0911-64de-429e-aa54-1aa5e6986332","Type":"ContainerStarted","Data":"5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755"}
Jul 27 19:35:57.573763 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.573686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9" event={"ID":"86ad0911-64de-429e-aa54-1aa5e6986332","Type":"ContainerStarted","Data":"9ff2e2ae69a4a0c425fd5791a33cb781ddbec5d64cc96a3c0eb51a7626acb1ef"}
Jul 27 19:35:57.573763 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.573729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:35:57.578503 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.578422    2559 scope.go:117] "RemoveContainer" containerID="f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a"
Jul 27 19:35:57.578737 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:57.578717    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a\": container with ID starting with f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a not found: ID does not exist" containerID="f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a"
Jul 27 19:35:57.578799 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.578743    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a"} err="failed to get container status \"f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a\": rpc error: code = NotFound desc = could not find container \"f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a\": container with ID starting with f42840f1900c9925db95a69cfb165c270f40ac7752dc71bc6416af88a2abe37a not found: ID does not exist"
Jul 27 19:35:57.578799 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.578759    2559 scope.go:117] "RemoveContainer" containerID="77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a"
Jul 27 19:35:57.585831 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.585789    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6ht5d" podStartSLOduration=1.828858518 podStartE2EDuration="22.585777977s" totalImagesPullingTime="20.756919459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:57.58438228 +0000 UTC m=+617.279938375" watchObservedRunningTime="2026-07-27 19:35:57.585777977 +0000 UTC m=+617.281334071"
Jul 27 19:35:57.586431 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:57.586394    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:57.586707 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.586692    2559 scope.go:117] "RemoveContainer" containerID="77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a"
Jul 27 19:35:57.586980 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:57.586959    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a\": container with ID starting with 77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a not found: ID does not exist" containerID="77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a"
Jul 27 19:35:57.587042 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.586987    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a"} err="failed to get container status \"77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a\": rpc error: code = NotFound desc = could not find container \"77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a\": container with ID starting with 77f59d70a3f3e2c51606fef3acafc0e99ee2eb755d14f06e0994c8e3d20f517a not found: ID does not exist"
Jul 27 19:35:57.588114 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:57.588094    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4srjv\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4srjv"
Jul 27 19:35:57.613381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.613332    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9" podStartSLOduration=12.61331186 podStartE2EDuration="12.61331186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:57.61025653 +0000 UTC m=+617.305812637" watchObservedRunningTime="2026-07-27 19:35:57.61331186 +0000 UTC m=+617.308867956"
Jul 27 19:35:57.630769 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:57.630728    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq" podStartSLOduration=12.630715929 podStartE2EDuration="12.630715929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:57.629281802 +0000 UTC m=+617.324837897" watchObservedRunningTime="2026-07-27 19:35:57.630715929 +0000 UTC m=+617.326272023"
Jul 27 19:35:57.631009 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:57.630981    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6tdwh\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6tdwh"
Jul 27 19:35:58.942249 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:58.942217    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" path="/var/lib/kubelet/pods/1a18c3fb-8ae7-48ef-b223-11f84a714c32/volumes"
Jul 27 19:35:58.942664 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:58.942649    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8fb757-dbb6-465a-b18c-1c3e0684e45f" path="/var/lib/kubelet/pods/9f8fb757-dbb6-465a-b18c-1c3e0684e45f/volumes"
Jul 27 19:35:59.341643 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:59.341604    2559 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-4bqqb_kuadrant-system_693ef560-c44c-4d67-b4da-5a908f3eb03b_0(6439fbfdb4f0d106ed929011cdb54654cdfea9023a2c18ec1e9a22a6004b0193): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-4bqqb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 27 19:35:59.341712 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:59.341663    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-4bqqb_kuadrant-system_693ef560-c44c-4d67-b4da-5a908f3eb03b_0(6439fbfdb4f0d106ed929011cdb54654cdfea9023a2c18ec1e9a22a6004b0193): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-4bqqb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:59.585989 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.585915    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:59.587988 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:59.587955    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="693ef560-c44c-4d67-b4da-5a908f3eb03b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:59.592945 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.592925    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:59.594981 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:35:59.594950    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="693ef560-c44c-4d67-b4da-5a908f3eb03b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:35:59.675084 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.675051    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/693ef560-c44c-4d67-b4da-5a908f3eb03b-extensions-socket-volume\") pod \"693ef560-c44c-4d67-b4da-5a908f3eb03b\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") "
Jul 27 19:35:59.675220 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.675204    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fg5j\" (UniqueName: \"kubernetes.io/projected/693ef560-c44c-4d67-b4da-5a908f3eb03b-kube-api-access-7fg5j\") pod \"693ef560-c44c-4d67-b4da-5a908f3eb03b\" (UID: \"693ef560-c44c-4d67-b4da-5a908f3eb03b\") "
Jul 27 19:35:59.675327 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.675302    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/693ef560-c44c-4d67-b4da-5a908f3eb03b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "693ef560-c44c-4d67-b4da-5a908f3eb03b" (UID: "693ef560-c44c-4d67-b4da-5a908f3eb03b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:35:59.675415 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.675404    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/693ef560-c44c-4d67-b4da-5a908f3eb03b-extensions-socket-volume\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:35:59.677223 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.677199    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/693ef560-c44c-4d67-b4da-5a908f3eb03b-kube-api-access-7fg5j" (OuterVolumeSpecName: "kube-api-access-7fg5j") pod "693ef560-c44c-4d67-b4da-5a908f3eb03b" (UID: "693ef560-c44c-4d67-b4da-5a908f3eb03b"). InnerVolumeSpecName "kube-api-access-7fg5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:35:59.776253 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:35:59.776217    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fg5j\" (UniqueName: \"kubernetes.io/projected/693ef560-c44c-4d67-b4da-5a908f3eb03b-kube-api-access-7fg5j\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:36:00.590565 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:00.590528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:36:00.592776 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:36:00.592742    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="693ef560-c44c-4d67-b4da-5a908f3eb03b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:36:00.598320 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:36:00.598292    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="693ef560-c44c-4d67-b4da-5a908f3eb03b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:36:00.940059 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:36:00.940025    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-4bqqb\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="693ef560-c44c-4d67-b4da-5a908f3eb03b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4bqqb"
Jul 27 19:36:00.941532 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:00.941497    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="693ef560-c44c-4d67-b4da-5a908f3eb03b" path="/var/lib/kubelet/pods/693ef560-c44c-4d67-b4da-5a908f3eb03b/volumes"
Jul 27 19:36:08.582959 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.582874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:36:08.582959 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.582939    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:36:08.650668 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.650625    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"]
Jul 27 19:36:08.650897 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.650824    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq" podUID="c977d8d3-e25c-4629-b24c-2b7872e6b363" containerName="manager" containerID="cri-o://6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c" gracePeriod=10
Jul 27 19:36:08.900135 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.900114    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:36:08.920422 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.920393    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"]
Jul 27 19:36:08.920742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.920725    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c977d8d3-e25c-4629-b24c-2b7872e6b363" containerName="manager"
Jul 27 19:36:08.920742 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.920739    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c977d8d3-e25c-4629-b24c-2b7872e6b363" containerName="manager"
Jul 27 19:36:08.920945 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.920753    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" containerName="manager"
Jul 27 19:36:08.920945 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.920759    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" containerName="manager"
Jul 27 19:36:08.920945 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.920826    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a18c3fb-8ae7-48ef-b223-11f84a714c32" containerName="manager"
Jul 27 19:36:08.920945 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.920835    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c977d8d3-e25c-4629-b24c-2b7872e6b363" containerName="manager"
Jul 27 19:36:08.923386 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.923363    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:08.943814 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.943793    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"]
Jul 27 19:36:08.959076 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.959051    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjnqw\" (UniqueName: \"kubernetes.io/projected/c977d8d3-e25c-4629-b24c-2b7872e6b363-kube-api-access-fjnqw\") pod \"c977d8d3-e25c-4629-b24c-2b7872e6b363\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") "
Jul 27 19:36:08.959248 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.959235    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c977d8d3-e25c-4629-b24c-2b7872e6b363-extensions-socket-volume\") pod \"c977d8d3-e25c-4629-b24c-2b7872e6b363\" (UID: \"c977d8d3-e25c-4629-b24c-2b7872e6b363\") "
Jul 27 19:36:08.959579 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.959556    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c977d8d3-e25c-4629-b24c-2b7872e6b363-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c977d8d3-e25c-4629-b24c-2b7872e6b363" (UID: "c977d8d3-e25c-4629-b24c-2b7872e6b363"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:36:08.961083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:08.961059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c977d8d3-e25c-4629-b24c-2b7872e6b363-kube-api-access-fjnqw" (OuterVolumeSpecName: "kube-api-access-fjnqw") pod "c977d8d3-e25c-4629-b24c-2b7872e6b363" (UID: "c977d8d3-e25c-4629-b24c-2b7872e6b363"). InnerVolumeSpecName "kube-api-access-fjnqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:36:09.060745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.060709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bwdhn\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.060745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.060749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56pcm\" (UniqueName: \"kubernetes.io/projected/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-kube-api-access-56pcm\") pod \"kuadrant-operator-controller-manager-86878c769f-bwdhn\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.061025 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.060991    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c977d8d3-e25c-4629-b24c-2b7872e6b363-extensions-socket-volume\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:36:09.061025 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.061018    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjnqw\" (UniqueName: \"kubernetes.io/projected/c977d8d3-e25c-4629-b24c-2b7872e6b363-kube-api-access-fjnqw\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:36:09.162119 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.162031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bwdhn\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.162119 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.162077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56pcm\" (UniqueName: \"kubernetes.io/projected/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-kube-api-access-56pcm\") pod \"kuadrant-operator-controller-manager-86878c769f-bwdhn\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.162500 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.162473    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bwdhn\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.173667 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.173643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56pcm\" (UniqueName: \"kubernetes.io/projected/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-kube-api-access-56pcm\") pod \"kuadrant-operator-controller-manager-86878c769f-bwdhn\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.234874 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.234809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.375429 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.375398    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"]
Jul 27 19:36:09.380367 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:36:09.380338    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575a6e2c_3d0b_4f75_9de4_35c53ddbaf7f.slice/crio-f9f2c246a7d08871c9f8bcf41a797a54caa0513c83871f0598045c087c943bc9 WatchSource:0}: Error finding container f9f2c246a7d08871c9f8bcf41a797a54caa0513c83871f0598045c087c943bc9: Status 404 returned error can't find the container with id f9f2c246a7d08871c9f8bcf41a797a54caa0513c83871f0598045c087c943bc9
Jul 27 19:36:09.637307 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.637275    2559 generic.go:356] "Generic (PLEG): container finished" podID="c977d8d3-e25c-4629-b24c-2b7872e6b363" containerID="6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c" exitCode=0
Jul 27 19:36:09.637770 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.637320    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"
Jul 27 19:36:09.637770 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.637356    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq" event={"ID":"c977d8d3-e25c-4629-b24c-2b7872e6b363","Type":"ContainerDied","Data":"6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c"}
Jul 27 19:36:09.637770 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.637405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq" event={"ID":"c977d8d3-e25c-4629-b24c-2b7872e6b363","Type":"ContainerDied","Data":"cb021330c4b36cc98824e0dc964452e50a3bef91fe76c681c2536aa917ac9286"}
Jul 27 19:36:09.637770 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.637427    2559 scope.go:117] "RemoveContainer" containerID="6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c"
Jul 27 19:36:09.639049 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.639021    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn" event={"ID":"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f","Type":"ContainerStarted","Data":"ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966"}
Jul 27 19:36:09.639143 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.639066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn" event={"ID":"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f","Type":"ContainerStarted","Data":"f9f2c246a7d08871c9f8bcf41a797a54caa0513c83871f0598045c087c943bc9"}
Jul 27 19:36:09.639211 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.639155    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:09.647258 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.647243    2559 scope.go:117] "RemoveContainer" containerID="6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c"
Jul 27 19:36:09.647520 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:36:09.647503    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c\": container with ID starting with 6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c not found: ID does not exist" containerID="6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c"
Jul 27 19:36:09.647565 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.647528    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c"} err="failed to get container status \"6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c\": rpc error: code = NotFound desc = could not find container \"6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c\": container with ID starting with 6a4105e119e4c9dfbf20215077cf4a718c98f20185e9c2daf5df8bcfdf6c081c not found: ID does not exist"
Jul 27 19:36:09.661596 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.661557    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn" podStartSLOduration=1.661543526 podStartE2EDuration="1.661543526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:09.661197065 +0000 UTC m=+629.356753159" watchObservedRunningTime="2026-07-27 19:36:09.661543526 +0000 UTC m=+629.357099619"
Jul 27 19:36:09.675995 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.675938    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"]
Jul 27 19:36:09.679135 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:09.679117    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q4qzq"]
Jul 27 19:36:10.942446 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:10.942414    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c977d8d3-e25c-4629-b24c-2b7872e6b363" path="/var/lib/kubelet/pods/c977d8d3-e25c-4629-b24c-2b7872e6b363/volumes"
Jul 27 19:36:20.647291 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:20.647260    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:36:20.695153 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:20.695109    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"]
Jul 27 19:36:20.695581 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:20.695482    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9" podUID="86ad0911-64de-429e-aa54-1aa5e6986332" containerName="manager" containerID="cri-o://5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755" gracePeriod=10
Jul 27 19:36:20.956613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:20.956586    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:36:21.065191 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.065153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ad0911-64de-429e-aa54-1aa5e6986332-extensions-socket-volume\") pod \"86ad0911-64de-429e-aa54-1aa5e6986332\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") "
Jul 27 19:36:21.065191 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.065196    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h476\" (UniqueName: \"kubernetes.io/projected/86ad0911-64de-429e-aa54-1aa5e6986332-kube-api-access-5h476\") pod \"86ad0911-64de-429e-aa54-1aa5e6986332\" (UID: \"86ad0911-64de-429e-aa54-1aa5e6986332\") "
Jul 27 19:36:21.065556 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.065531    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86ad0911-64de-429e-aa54-1aa5e6986332-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86ad0911-64de-429e-aa54-1aa5e6986332" (UID: "86ad0911-64de-429e-aa54-1aa5e6986332"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:36:21.067683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.067656    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86ad0911-64de-429e-aa54-1aa5e6986332-kube-api-access-5h476" (OuterVolumeSpecName: "kube-api-access-5h476") pod "86ad0911-64de-429e-aa54-1aa5e6986332" (UID: "86ad0911-64de-429e-aa54-1aa5e6986332"). InnerVolumeSpecName "kube-api-access-5h476". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:36:21.166390 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.166346    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ad0911-64de-429e-aa54-1aa5e6986332-extensions-socket-volume\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:36:21.166390 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.166381    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h476\" (UniqueName: \"kubernetes.io/projected/86ad0911-64de-429e-aa54-1aa5e6986332-kube-api-access-5h476\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:36:21.700202 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.700165    2559 generic.go:356] "Generic (PLEG): container finished" podID="86ad0911-64de-429e-aa54-1aa5e6986332" containerID="5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755" exitCode=0
Jul 27 19:36:21.700603 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.700219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9" event={"ID":"86ad0911-64de-429e-aa54-1aa5e6986332","Type":"ContainerDied","Data":"5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755"}
Jul 27 19:36:21.700603 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.700226    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"
Jul 27 19:36:21.700603 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.700288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9" event={"ID":"86ad0911-64de-429e-aa54-1aa5e6986332","Type":"ContainerDied","Data":"9ff2e2ae69a4a0c425fd5791a33cb781ddbec5d64cc96a3c0eb51a7626acb1ef"}
Jul 27 19:36:21.700603 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.700311    2559 scope.go:117] "RemoveContainer" containerID="5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755"
Jul 27 19:36:21.709463 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.709446    2559 scope.go:117] "RemoveContainer" containerID="5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755"
Jul 27 19:36:21.709737 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:36:21.709717    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755\": container with ID starting with 5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755 not found: ID does not exist" containerID="5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755"
Jul 27 19:36:21.709785 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.709746    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755"} err="failed to get container status \"5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755\": rpc error: code = NotFound desc = could not find container \"5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755\": container with ID starting with 5773a66233cad9c2c57296ff8c32afe3389ece9446f6f8d605e854a195bdd755 not found: ID does not exist"
Jul 27 19:36:21.721141 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.721114    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"]
Jul 27 19:36:21.726505 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:21.726480    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7v5z9"]
Jul 27 19:36:22.942625 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:22.942591    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86ad0911-64de-429e-aa54-1aa5e6986332" path="/var/lib/kubelet/pods/86ad0911-64de-429e-aa54-1aa5e6986332/volumes"
Jul 27 19:36:24.973030 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:24.972997    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"]
Jul 27 19:36:24.973411 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:24.973356    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86ad0911-64de-429e-aa54-1aa5e6986332" containerName="manager"
Jul 27 19:36:24.973411 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:24.973367    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="86ad0911-64de-429e-aa54-1aa5e6986332" containerName="manager"
Jul 27 19:36:24.973493 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:24.973431    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="86ad0911-64de-429e-aa54-1aa5e6986332" containerName="manager"
Jul 27 19:36:24.999702 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:24.999674    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"]
Jul 27 19:36:24.999873 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:24.999767    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.002122 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.002103    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pcnh2\""
Jul 27 19:36:25.100116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100301 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100301 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100301 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49151180-351a-4a01-a1c7-98335af6a6db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100487 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49151180-351a-4a01-a1c7-98335af6a6db-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100546 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49151180-351a-4a01-a1c7-98335af6a6db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100598 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100598 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.100682 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.100614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8fwp\" (UniqueName: \"kubernetes.io/projected/49151180-351a-4a01-a1c7-98335af6a6db-kube-api-access-v8fwp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201443 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201443 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201626 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8fwp\" (UniqueName: \"kubernetes.io/projected/49151180-351a-4a01-a1c7-98335af6a6db-kube-api-access-v8fwp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201626 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201626 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201626 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201827 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49151180-351a-4a01-a1c7-98335af6a6db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201827 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49151180-351a-4a01-a1c7-98335af6a6db-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.201827 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49151180-351a-4a01-a1c7-98335af6a6db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.202028 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.201882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.202087 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.202024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.202147 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.202077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.202218 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.202199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.202469 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.202451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49151180-351a-4a01-a1c7-98335af6a6db-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.203758 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.203737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49151180-351a-4a01-a1c7-98335af6a6db-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.203987 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.203971    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49151180-351a-4a01-a1c7-98335af6a6db-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.211027 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.211001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49151180-351a-4a01-a1c7-98335af6a6db-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.211388 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.211365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8fwp\" (UniqueName: \"kubernetes.io/projected/49151180-351a-4a01-a1c7-98335af6a6db-kube-api-access-v8fwp\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6qhzj\" (UID: \"49151180-351a-4a01-a1c7-98335af6a6db\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.311521 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.311438    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:25.448630 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.448605    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"]
Jul 27 19:36:25.450962 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:36:25.450935    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49151180_351a_4a01_a1c7_98335af6a6db.slice/crio-62f6890b01715d6880f5d97b13019a6a0fa4adcbfad284089cc149573436a1d7 WatchSource:0}: Error finding container 62f6890b01715d6880f5d97b13019a6a0fa4adcbfad284089cc149573436a1d7: Status 404 returned error can't find the container with id 62f6890b01715d6880f5d97b13019a6a0fa4adcbfad284089cc149573436a1d7
Jul 27 19:36:25.453616 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.453578    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:36:25.453683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.453668    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:36:25.453720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.453708    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:36:25.726300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.726257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" event={"ID":"49151180-351a-4a01-a1c7-98335af6a6db","Type":"ContainerStarted","Data":"ff60bc2480a39e37dcd8288be559dab428e6305eed57f4213c94058c8a26f429"}
Jul 27 19:36:25.726480 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.726317    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" event={"ID":"49151180-351a-4a01-a1c7-98335af6a6db","Type":"ContainerStarted","Data":"62f6890b01715d6880f5d97b13019a6a0fa4adcbfad284089cc149573436a1d7"}
Jul 27 19:36:25.747402 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:25.747356    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" podStartSLOduration=1.747341885 podStartE2EDuration="1.747341885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:25.746030966 +0000 UTC m=+645.441587061" watchObservedRunningTime="2026-07-27 19:36:25.747341885 +0000 UTC m=+645.442897978"
Jul 27 19:36:26.311889 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:26.311827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:26.316687 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:26.316662    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:26.732137 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:26.732111    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:26.733002 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:26.732982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:36:40.687831 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.687799    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:36:40.690608 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.690586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:40.692732 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.692710    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 19:36:40.701903 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.701881    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:36:40.718033 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.718000    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:36:40.736866 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.736827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d67z6\" (UniqueName: \"kubernetes.io/projected/a1ad2cc0-f4fa-4638-89f5-a349d33b547c-kube-api-access-d67z6\") pod \"limitador-limitador-54d6d988d5-z7r7v\" (UID: \"a1ad2cc0-f4fa-4638-89f5-a349d33b547c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:40.737032 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.736942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1ad2cc0-f4fa-4638-89f5-a349d33b547c-config-file\") pod \"limitador-limitador-54d6d988d5-z7r7v\" (UID: \"a1ad2cc0-f4fa-4638-89f5-a349d33b547c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:40.837553 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.837523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d67z6\" (UniqueName: \"kubernetes.io/projected/a1ad2cc0-f4fa-4638-89f5-a349d33b547c-kube-api-access-d67z6\") pod \"limitador-limitador-54d6d988d5-z7r7v\" (UID: \"a1ad2cc0-f4fa-4638-89f5-a349d33b547c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:40.837685 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.837567    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1ad2cc0-f4fa-4638-89f5-a349d33b547c-config-file\") pod \"limitador-limitador-54d6d988d5-z7r7v\" (UID: \"a1ad2cc0-f4fa-4638-89f5-a349d33b547c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:40.840073 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.840056    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 19:36:40.845701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.845673    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d67z6\" (UniqueName: \"kubernetes.io/projected/a1ad2cc0-f4fa-4638-89f5-a349d33b547c-kube-api-access-d67z6\") pod \"limitador-limitador-54d6d988d5-z7r7v\" (UID: \"a1ad2cc0-f4fa-4638-89f5-a349d33b547c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:40.849076 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:40.849054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1ad2cc0-f4fa-4638-89f5-a349d33b547c-config-file\") pod \"limitador-limitador-54d6d988d5-z7r7v\" (UID: \"a1ad2cc0-f4fa-4638-89f5-a349d33b547c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:41.002015 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.001932    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:41.134017 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.133983    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:36:41.136701 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:36:41.136676    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ad2cc0_f4fa_4638_89f5_a349d33b547c.slice/crio-55111328b3bdec28dd614b24528b7db893e628befd733603cba2e44d11b5bd5a WatchSource:0}: Error finding container 55111328b3bdec28dd614b24528b7db893e628befd733603cba2e44d11b5bd5a: Status 404 returned error can't find the container with id 55111328b3bdec28dd614b24528b7db893e628befd733603cba2e44d11b5bd5a
Jul 27 19:36:41.146463 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.146439    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2kmnr"]
Jul 27 19:36:41.149592 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.149577    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2kmnr"
Jul 27 19:36:41.151496 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.151480    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rfc27\""
Jul 27 19:36:41.155970 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.155948    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2kmnr"]
Jul 27 19:36:41.241678 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.241646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbvt5\" (UniqueName: \"kubernetes.io/projected/551ad3a1-6ad0-41c3-ad46-163aea28aba9-kube-api-access-gbvt5\") pod \"authorino-75d556bd77-2kmnr\" (UID: \"551ad3a1-6ad0-41c3-ad46-163aea28aba9\") " pod="kuadrant-system/authorino-75d556bd77-2kmnr"
Jul 27 19:36:41.343108 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.343027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbvt5\" (UniqueName: \"kubernetes.io/projected/551ad3a1-6ad0-41c3-ad46-163aea28aba9-kube-api-access-gbvt5\") pod \"authorino-75d556bd77-2kmnr\" (UID: \"551ad3a1-6ad0-41c3-ad46-163aea28aba9\") " pod="kuadrant-system/authorino-75d556bd77-2kmnr"
Jul 27 19:36:41.350940 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.350913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbvt5\" (UniqueName: \"kubernetes.io/projected/551ad3a1-6ad0-41c3-ad46-163aea28aba9-kube-api-access-gbvt5\") pod \"authorino-75d556bd77-2kmnr\" (UID: \"551ad3a1-6ad0-41c3-ad46-163aea28aba9\") " pod="kuadrant-system/authorino-75d556bd77-2kmnr"
Jul 27 19:36:41.459306 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.459273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2kmnr"
Jul 27 19:36:41.627402 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.627292    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2kmnr"]
Jul 27 19:36:41.632068 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:36:41.632034    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod551ad3a1_6ad0_41c3_ad46_163aea28aba9.slice/crio-2496b586d29d72fdb55afa2dc58ab160d3f780a0b89c7e20a9657aa1818e02c6 WatchSource:0}: Error finding container 2496b586d29d72fdb55afa2dc58ab160d3f780a0b89c7e20a9657aa1818e02c6: Status 404 returned error can't find the container with id 2496b586d29d72fdb55afa2dc58ab160d3f780a0b89c7e20a9657aa1818e02c6
Jul 27 19:36:41.808583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.808507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2kmnr" event={"ID":"551ad3a1-6ad0-41c3-ad46-163aea28aba9","Type":"ContainerStarted","Data":"2496b586d29d72fdb55afa2dc58ab160d3f780a0b89c7e20a9657aa1818e02c6"}
Jul 27 19:36:41.809991 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:41.809928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v" event={"ID":"a1ad2cc0-f4fa-4638-89f5-a349d33b547c","Type":"ContainerStarted","Data":"55111328b3bdec28dd614b24528b7db893e628befd733603cba2e44d11b5bd5a"}
Jul 27 19:36:45.838191 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:45.838149    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v" event={"ID":"a1ad2cc0-f4fa-4638-89f5-a349d33b547c","Type":"ContainerStarted","Data":"a8762ac7c89aa7659af8ef4024ebe943a7176ba05ebc58a2af28a9e3ac5c3fb4"}
Jul 27 19:36:45.838686 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:45.838253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:36:45.839572 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:45.839547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2kmnr" event={"ID":"551ad3a1-6ad0-41c3-ad46-163aea28aba9","Type":"ContainerStarted","Data":"b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565"}
Jul 27 19:36:45.854255 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:45.854216    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v" podStartSLOduration=1.68367131 podStartE2EDuration="5.854202631s" totalImagesPullingTime="4.170531321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:45.852958358 +0000 UTC m=+665.548514451" watchObservedRunningTime="2026-07-27 19:36:45.854202631 +0000 UTC m=+665.549758899"
Jul 27 19:36:45.865921 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:45.865882    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2kmnr" podStartSLOduration=1.18871014 podStartE2EDuration="4.865843299s" totalImagesPullingTime="3.677133159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:45.865697809 +0000 UTC m=+665.561253903" watchObservedRunningTime="2026-07-27 19:36:45.865843299 +0000 UTC m=+665.561399393"
Jul 27 19:36:56.845910 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:36:56.845880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"
Jul 27 19:37:13.410745 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.410709    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2kmnr"]
Jul 27 19:37:13.411323 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.410911    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2kmnr" podUID="551ad3a1-6ad0-41c3-ad46-163aea28aba9" containerName="authorino" containerID="cri-o://b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565" gracePeriod=30
Jul 27 19:37:13.677889 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.677844    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2kmnr"
Jul 27 19:37:13.846766 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.846736    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbvt5\" (UniqueName: \"kubernetes.io/projected/551ad3a1-6ad0-41c3-ad46-163aea28aba9-kube-api-access-gbvt5\") pod \"551ad3a1-6ad0-41c3-ad46-163aea28aba9\" (UID: \"551ad3a1-6ad0-41c3-ad46-163aea28aba9\") "
Jul 27 19:37:13.848752 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.848723    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551ad3a1-6ad0-41c3-ad46-163aea28aba9-kube-api-access-gbvt5" (OuterVolumeSpecName: "kube-api-access-gbvt5") pod "551ad3a1-6ad0-41c3-ad46-163aea28aba9" (UID: "551ad3a1-6ad0-41c3-ad46-163aea28aba9"). InnerVolumeSpecName "kube-api-access-gbvt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:37:13.947957 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.947926    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbvt5\" (UniqueName: \"kubernetes.io/projected/551ad3a1-6ad0-41c3-ad46-163aea28aba9-kube-api-access-gbvt5\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:37:13.967792 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.967759    2559 generic.go:356] "Generic (PLEG): container finished" podID="551ad3a1-6ad0-41c3-ad46-163aea28aba9" containerID="b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565" exitCode=0
Jul 27 19:37:13.967949 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.967799    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2kmnr"
Jul 27 19:37:13.967949 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.967832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2kmnr" event={"ID":"551ad3a1-6ad0-41c3-ad46-163aea28aba9","Type":"ContainerDied","Data":"b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565"}
Jul 27 19:37:13.967949 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.967889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2kmnr" event={"ID":"551ad3a1-6ad0-41c3-ad46-163aea28aba9","Type":"ContainerDied","Data":"2496b586d29d72fdb55afa2dc58ab160d3f780a0b89c7e20a9657aa1818e02c6"}
Jul 27 19:37:13.967949 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.967910    2559 scope.go:117] "RemoveContainer" containerID="b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565"
Jul 27 19:37:13.976514 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.976496    2559 scope.go:117] "RemoveContainer" containerID="b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565"
Jul 27 19:37:13.976772 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:37:13.976755    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565\": container with ID starting with b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565 not found: ID does not exist" containerID="b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565"
Jul 27 19:37:13.976820 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.976781    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565"} err="failed to get container status \"b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565\": rpc error: code = NotFound desc = could not find container \"b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565\": container with ID starting with b38b2a9b8cface2d9519bb90f8036d9801374130422c4c672bbe9c8fac808565 not found: ID does not exist"
Jul 27 19:37:13.987935 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.987911    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2kmnr"]
Jul 27 19:37:13.991663 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:13.991644    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2kmnr"]
Jul 27 19:37:14.941990 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:14.941960    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="551ad3a1-6ad0-41c3-ad46-163aea28aba9" path="/var/lib/kubelet/pods/551ad3a1-6ad0-41c3-ad46-163aea28aba9/volumes"
Jul 27 19:37:54.712702 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:37:54.712665    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:38:02.196718 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:02.196682    2559 generic.go:356] "Generic (PLEG): container finished" podID="49151180-351a-4a01-a1c7-98335af6a6db" containerID="ff60bc2480a39e37dcd8288be559dab428e6305eed57f4213c94058c8a26f429" exitCode=0
Jul 27 19:38:02.197170 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:02.196749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" event={"ID":"49151180-351a-4a01-a1c7-98335af6a6db","Type":"ContainerDied","Data":"ff60bc2480a39e37dcd8288be559dab428e6305eed57f4213c94058c8a26f429"}
Jul 27 19:38:02.197215 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:02.197178    2559 scope.go:117] "RemoveContainer" containerID="ff60bc2480a39e37dcd8288be559dab428e6305eed57f4213c94058c8a26f429"
Jul 27 19:38:02.198221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:02.198194    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:38:02.198280 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:02.198264    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:38:02.198317 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:02.198295    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:38:03.203039 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:03.203000    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" event={"ID":"49151180-351a-4a01-a1c7-98335af6a6db","Type":"ContainerStarted","Data":"d2cc0e82794013d7f1038a42860a326af91369c1cd1fc32ad4d41c4a01855ad9"}
Jul 27 19:38:03.312504 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:03.312461    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:38:03.312761 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:03.312733    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6qhzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 19:38:03.312873 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:03.312802    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" podUID="49151180-351a-4a01-a1c7-98335af6a6db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 19:38:04.312305 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:04.312268    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6qhzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 19:38:04.312925 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:04.312891    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" podUID="49151180-351a-4a01-a1c7-98335af6a6db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 19:38:05.312167 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:05.312121    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6qhzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 19:38:05.312380 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:05.312190    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" podUID="49151180-351a-4a01-a1c7-98335af6a6db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 19:38:06.312755 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:06.312717    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6qhzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 19:38:06.313362 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:06.313330    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj" podUID="49151180-351a-4a01-a1c7-98335af6a6db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 19:38:07.316019 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:07.315988    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:38:07.316419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:07.316259    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:38:07.317024 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:07.317004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6qhzj"
Jul 27 19:38:13.270061 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:13.270029    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:38:25.765449 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:25.765418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:38:35.962694 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:35.962661    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:38:48.803012 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.802982    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"]
Jul 27 19:38:48.803393 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.803365    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551ad3a1-6ad0-41c3-ad46-163aea28aba9" containerName="authorino"
Jul 27 19:38:48.803393 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.803377    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="551ad3a1-6ad0-41c3-ad46-163aea28aba9" containerName="authorino"
Jul 27 19:38:48.803471 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.803449    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="551ad3a1-6ad0-41c3-ad46-163aea28aba9" containerName="authorino"
Jul 27 19:38:48.805683 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.805665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.808776 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.808750    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:38:48.808975 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.808792    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pt647\""
Jul 27 19:38:48.808975 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.808748    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:38:48.808975 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.808757    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 19:38:48.817194 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.817173    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"]
Jul 27 19:38:48.873778 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.873749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.873778 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.873787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpz8\" (UniqueName: \"kubernetes.io/projected/c746f3e6-0e46-4b39-a95e-30651e2b262f-kube-api-access-lrpz8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.874018 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.873812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c746f3e6-0e46-4b39-a95e-30651e2b262f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.874018 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.873902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.874018 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.873921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.874018 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.873954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975326 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975326 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975569 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975569 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975569 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpz8\" (UniqueName: \"kubernetes.io/projected/c746f3e6-0e46-4b39-a95e-30651e2b262f-kube-api-access-lrpz8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975569 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c746f3e6-0e46-4b39-a95e-30651e2b262f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975758 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975817 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.975924 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.975904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.977764 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.977743    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c746f3e6-0e46-4b39-a95e-30651e2b262f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.977963 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.977947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c746f3e6-0e46-4b39-a95e-30651e2b262f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:48.983495 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:48.983471    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpz8\" (UniqueName: \"kubernetes.io/projected/c746f3e6-0e46-4b39-a95e-30651e2b262f-kube-api-access-lrpz8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc\" (UID: \"c746f3e6-0e46-4b39-a95e-30651e2b262f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:49.116979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:49.116874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:49.247891 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:49.247867    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"]
Jul 27 19:38:49.250222 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:38:49.250198    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc746f3e6_0e46_4b39_a95e_30651e2b262f.slice/crio-1ad33b8b9998bbe0506982b06637457469b119b1430478b2e2418c4c6a57f386 WatchSource:0}: Error finding container 1ad33b8b9998bbe0506982b06637457469b119b1430478b2e2418c4c6a57f386: Status 404 returned error can't find the container with id 1ad33b8b9998bbe0506982b06637457469b119b1430478b2e2418c4c6a57f386
Jul 27 19:38:49.251558 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:49.251537    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:38:49.441134 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:49.441095    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc" event={"ID":"c746f3e6-0e46-4b39-a95e-30651e2b262f","Type":"ContainerStarted","Data":"1ad33b8b9998bbe0506982b06637457469b119b1430478b2e2418c4c6a57f386"}
Jul 27 19:38:50.449779 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:50.449741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc" event={"ID":"c746f3e6-0e46-4b39-a95e-30651e2b262f","Type":"ContainerStarted","Data":"c59a234d18d9d2e5f43203fc7aeb416afce74ecc93567908d90c2ec94fecc099"}
Jul 27 19:38:50.466542 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:50.466488    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc" podStartSLOduration=1.4812203259999999 podStartE2EDuration="2.466471778s" totalImagesPullingTime="985.251452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:38:50.464946822 +0000 UTC m=+790.160502917" watchObservedRunningTime="2026-07-27 19:38:50.466471778 +0000 UTC m=+790.162027918"
Jul 27 19:38:50.668116 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:50.668024    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:38:59.117431 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:59.117393    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:59.117838 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:59.117465    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:59.130013 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:59.129985    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:38:59.502353 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:38:59.502323    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc"
Jul 27 19:39:08.457034 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:39:08.456936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:39:25.465087 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:39:25.465048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:40:40.432874 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.432820    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-869696d786-tz9q2"]
Jul 27 19:40:40.436419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.436395    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.439670 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.439646    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 19:40:40.439936 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.439915    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rfc27\""
Jul 27 19:40:40.442430 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.442405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869696d786-tz9q2"]
Jul 27 19:40:40.482211 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.482179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkzf\" (UniqueName: \"kubernetes.io/projected/7969bd6f-be19-4674-b55c-81e2d6aaafac-kube-api-access-7qkzf\") pod \"authorino-869696d786-tz9q2\" (UID: \"7969bd6f-be19-4674-b55c-81e2d6aaafac\") " pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.482381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.482238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7969bd6f-be19-4674-b55c-81e2d6aaafac-tls-cert\") pod \"authorino-869696d786-tz9q2\" (UID: \"7969bd6f-be19-4674-b55c-81e2d6aaafac\") " pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.582867 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.582828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7969bd6f-be19-4674-b55c-81e2d6aaafac-tls-cert\") pod \"authorino-869696d786-tz9q2\" (UID: \"7969bd6f-be19-4674-b55c-81e2d6aaafac\") " pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.583038 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.582985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkzf\" (UniqueName: \"kubernetes.io/projected/7969bd6f-be19-4674-b55c-81e2d6aaafac-kube-api-access-7qkzf\") pod \"authorino-869696d786-tz9q2\" (UID: \"7969bd6f-be19-4674-b55c-81e2d6aaafac\") " pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.585319 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.585293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7969bd6f-be19-4674-b55c-81e2d6aaafac-tls-cert\") pod \"authorino-869696d786-tz9q2\" (UID: \"7969bd6f-be19-4674-b55c-81e2d6aaafac\") " pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.590173 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.590148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkzf\" (UniqueName: \"kubernetes.io/projected/7969bd6f-be19-4674-b55c-81e2d6aaafac-kube-api-access-7qkzf\") pod \"authorino-869696d786-tz9q2\" (UID: \"7969bd6f-be19-4674-b55c-81e2d6aaafac\") " pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.750670 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.750574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rfc27\""
Jul 27 19:40:40.758548 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.758525    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869696d786-tz9q2"
Jul 27 19:40:40.823032 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.823003    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:40:40.823183 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.823051    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:40:40.831053 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.831024    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:40:40.831291 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.831272    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:40:40.900407 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.900386    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869696d786-tz9q2"]
Jul 27 19:40:40.902556 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:40:40.902531    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7969bd6f_be19_4674_b55c_81e2d6aaafac.slice/crio-cf8ab3aaf838da31384a3c25a1f9b986f25d795ac665bac720530a118d5d5554 WatchSource:0}: Error finding container cf8ab3aaf838da31384a3c25a1f9b986f25d795ac665bac720530a118d5d5554: Status 404 returned error can't find the container with id cf8ab3aaf838da31384a3c25a1f9b986f25d795ac665bac720530a118d5d5554
Jul 27 19:40:40.973759 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:40.973725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869696d786-tz9q2" event={"ID":"7969bd6f-be19-4674-b55c-81e2d6aaafac","Type":"ContainerStarted","Data":"cf8ab3aaf838da31384a3c25a1f9b986f25d795ac665bac720530a118d5d5554"}
Jul 27 19:40:41.980501 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:41.980466    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869696d786-tz9q2" event={"ID":"7969bd6f-be19-4674-b55c-81e2d6aaafac","Type":"ContainerStarted","Data":"752d5847516eab3ac54b1f61a936843da8f30785dfd49f570ee90c2fa5ef8504"}
Jul 27 19:40:41.998410 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:40:41.998363    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-869696d786-tz9q2" podStartSLOduration=1.632000633 podStartE2EDuration="1.998347412s" totalImagesPullingTime="366.346779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:40:41.997259764 +0000 UTC m=+901.692815854" watchObservedRunningTime="2026-07-27 19:40:41.998347412 +0000 UTC m=+901.693903502"
Jul 27 19:41:11.961506 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:41:11.961463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:41:21.858176 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:41:21.858134    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:41:31.900779 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:41:31.900744    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:43:13.466538 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:43:13.466502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:43:45.567371 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:43:45.567290    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:43:55.551580 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:43:55.551543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:44:04.456863 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:44:04.454402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:44:15.861471 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:44:15.861435    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:44:25.761624 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:44:25.761583    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:44:35.369593 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:44:35.369564    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:44:47.063677 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:44:47.063637    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:44:56.562285 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:44:56.562250    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:45:18.665496 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:45:18.665458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:45:30.468011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:45:30.467980    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:45:40.856419 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:45:40.856391    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:45:40.857950 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:45:40.857927    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:45:40.860988 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:45:40.860967    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:45:40.862574 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:45:40.862553    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:45:53.565004 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:45:53.564964    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:46:04.459962 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:46:04.459923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:46:19.565835 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:46:19.565797    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:46:28.867691 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:46:28.867651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:46:39.367388 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:46:39.367288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:46:48.766542 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:46:48.766505    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:46:58.459376 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:46:58.459337    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:47:23.348061 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:23.348020    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"]
Jul 27 19:47:23.348822 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:23.348245    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn" podUID="575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" containerName="manager" containerID="cri-o://ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966" gracePeriod=10
Jul 27 19:47:27.609776 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.609751    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:47:27.721239 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.721141    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-extensions-socket-volume\") pod \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") "
Jul 27 19:47:27.721239 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.721184    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56pcm\" (UniqueName: \"kubernetes.io/projected/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-kube-api-access-56pcm\") pod \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\" (UID: \"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f\") "
Jul 27 19:47:27.721530 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.721505    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" (UID: "575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:47:27.723366 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.723335    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-kube-api-access-56pcm" (OuterVolumeSpecName: "kube-api-access-56pcm") pod "575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" (UID: "575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f"). InnerVolumeSpecName "kube-api-access-56pcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:47:27.822028 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.821990    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-extensions-socket-volume\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:47:27.822028 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.822020    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56pcm\" (UniqueName: \"kubernetes.io/projected/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f-kube-api-access-56pcm\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:47:27.994760 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.994666    2559 generic.go:356] "Generic (PLEG): container finished" podID="575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" containerID="ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966" exitCode=0
Jul 27 19:47:27.994760 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.994712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn" event={"ID":"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f","Type":"ContainerDied","Data":"ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966"}
Jul 27 19:47:27.994760 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.994715    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"
Jul 27 19:47:27.994760 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.994754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn" event={"ID":"575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f","Type":"ContainerDied","Data":"f9f2c246a7d08871c9f8bcf41a797a54caa0513c83871f0598045c087c943bc9"}
Jul 27 19:47:27.995127 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:27.994775    2559 scope.go:117] "RemoveContainer" containerID="ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966"
Jul 27 19:47:28.005256 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:28.005235    2559 scope.go:117] "RemoveContainer" containerID="ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966"
Jul 27 19:47:28.005514 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:47:28.005498    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966\": container with ID starting with ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966 not found: ID does not exist" containerID="ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966"
Jul 27 19:47:28.005561 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:28.005523    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966"} err="failed to get container status \"ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966\": rpc error: code = NotFound desc = could not find container \"ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966\": container with ID starting with ef8465e803b42bd1177d5c8bf3c8b0afbd18988be33bcd997dc10f93f5fdc966 not found: ID does not exist"
Jul 27 19:47:28.015823 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:28.015795    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"]
Jul 27 19:47:28.019125 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:28.019101    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bwdhn"]
Jul 27 19:47:28.941532 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:47:28.941499    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" path="/var/lib/kubelet/pods/575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f/volumes"
Jul 27 19:48:24.439908 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.439870    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"]
Jul 27 19:48:24.442466 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.440263    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" containerName="manager"
Jul 27 19:48:24.442466 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.440274    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" containerName="manager"
Jul 27 19:48:24.442466 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.440345    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="575a6e2c-3d0b-4f75-9de4-35c53ddbaf7f" containerName="manager"
Jul 27 19:48:24.443289 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.443273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.447059 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.447034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4pxj2\""
Jul 27 19:48:24.459807 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.459785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"]
Jul 27 19:48:24.528560 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.528521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pz5v\" (UniqueName: \"kubernetes.io/projected/dca21add-0cbf-409b-aa3b-3a101bcae3b8-kube-api-access-8pz5v\") pod \"kuadrant-operator-controller-manager-86878c769f-mkgt6\" (UID: \"dca21add-0cbf-409b-aa3b-3a101bcae3b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.528743 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.528572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca21add-0cbf-409b-aa3b-3a101bcae3b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mkgt6\" (UID: \"dca21add-0cbf-409b-aa3b-3a101bcae3b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.629457 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.629421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pz5v\" (UniqueName: \"kubernetes.io/projected/dca21add-0cbf-409b-aa3b-3a101bcae3b8-kube-api-access-8pz5v\") pod \"kuadrant-operator-controller-manager-86878c769f-mkgt6\" (UID: \"dca21add-0cbf-409b-aa3b-3a101bcae3b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.629634 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.629468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca21add-0cbf-409b-aa3b-3a101bcae3b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mkgt6\" (UID: \"dca21add-0cbf-409b-aa3b-3a101bcae3b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.629824 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.629806    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dca21add-0cbf-409b-aa3b-3a101bcae3b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mkgt6\" (UID: \"dca21add-0cbf-409b-aa3b-3a101bcae3b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.637085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.637061    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pz5v\" (UniqueName: \"kubernetes.io/projected/dca21add-0cbf-409b-aa3b-3a101bcae3b8-kube-api-access-8pz5v\") pod \"kuadrant-operator-controller-manager-86878c769f-mkgt6\" (UID: \"dca21add-0cbf-409b-aa3b-3a101bcae3b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.753161 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.753070    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:24.893073 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:24.893050    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"]
Jul 27 19:48:24.895397 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:48:24.895372    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca21add_0cbf_409b_aa3b_3a101bcae3b8.slice/crio-bfbe43605e2d546137b9f204393b2b99eff678b288513f6736be3488557405b8 WatchSource:0}: Error finding container bfbe43605e2d546137b9f204393b2b99eff678b288513f6736be3488557405b8: Status 404 returned error can't find the container with id bfbe43605e2d546137b9f204393b2b99eff678b288513f6736be3488557405b8
Jul 27 19:48:25.265492 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:25.265458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6" event={"ID":"dca21add-0cbf-409b-aa3b-3a101bcae3b8","Type":"ContainerStarted","Data":"927e70cc8c8b76b0abd7883a7432111cc41a6abf9f2731d6b5d023c12d64a85e"}
Jul 27 19:48:25.265668 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:25.265514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6" event={"ID":"dca21add-0cbf-409b-aa3b-3a101bcae3b8","Type":"ContainerStarted","Data":"bfbe43605e2d546137b9f204393b2b99eff678b288513f6736be3488557405b8"}
Jul 27 19:48:25.265668 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:25.265541    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:25.288961 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:25.288915    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6" podStartSLOduration=1.2889009009999999 podStartE2EDuration="1.288900901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:48:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:48:25.286189795 +0000 UTC m=+1364.981745895" watchObservedRunningTime="2026-07-27 19:48:25.288900901 +0000 UTC m=+1364.984456972"
Jul 27 19:48:36.273704 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:36.273671    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mkgt6"
Jul 27 19:48:45.868414 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:45.868370    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:48:57.362370 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:48:57.362331    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:49:05.961874 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:49:05.961822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:49:17.361328 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:49:17.361288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:49:26.958269 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:49:26.958233    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:49:38.765226 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:49:38.765192    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:49:47.163099 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:49:47.163059    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:49:57.257386 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:49:57.257350    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:50:08.862106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:08.862073    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:50:17.562451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:17.562413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:50:28.259672 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:28.259636    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:50:40.884877 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:40.884827    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:50:40.886796 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:40.886774    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:50:40.889519 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:40.889500    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:50:40.891196 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:40.891179    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:50:49.560049 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:49.560013    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:50:59.658066 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:50:59.658032    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:51:10.701020 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.700946    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"]
Jul 27 19:51:10.704234 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.704217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.706496 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.706473    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-f3c3fead-kserve-self-signed-certs\""
Jul 27 19:51:10.719937 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.719910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"]
Jul 27 19:51:10.811594 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.811560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-home\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.811768 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.811611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-tmp-dir\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.811768 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.811684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-dshm\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.811768 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.811757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-model-cache\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.811920 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.811790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c97802-0be2-412b-b4c3-351ecdede0c5-tls-certs\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.811920 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.811810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4mlf\" (UniqueName: \"kubernetes.io/projected/d8c97802-0be2-412b-b4c3-351ecdede0c5-kube-api-access-l4mlf\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912398 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-tmp-dir\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-dshm\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-model-cache\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c97802-0be2-412b-b4c3-351ecdede0c5-tls-certs\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4mlf\" (UniqueName: \"kubernetes.io/projected/d8c97802-0be2-412b-b4c3-351ecdede0c5-kube-api-access-l4mlf\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-home\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912955 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-tmp-dir\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.912955 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-model-cache\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.913032 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.912966    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-home\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.914886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.914843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-dshm\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.915131 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.915117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c97802-0be2-412b-b4c3-351ecdede0c5-tls-certs\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:10.919986 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:10.919963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4mlf\" (UniqueName: \"kubernetes.io/projected/d8c97802-0be2-412b-b4c3-351ecdede0c5-kube-api-access-l4mlf\") pod \"e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") " pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:11.012835 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:11.012726    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:11.150661 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:11.150628    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"]
Jul 27 19:51:12.103591 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:12.103552    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86" event={"ID":"d8c97802-0be2-412b-b4c3-351ecdede0c5","Type":"ContainerStarted","Data":"b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e"}
Jul 27 19:51:12.104059 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:12.103599    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86" event={"ID":"d8c97802-0be2-412b-b4c3-351ecdede0c5","Type":"ContainerStarted","Data":"c13c2f0f9bc1ae3d633fc0e2a35286e639e151eebb61a633855562f8ac75a7c5"}
Jul 27 19:51:12.119184 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:12.119126    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86" podStartSLOduration=2.119108565 podStartE2EDuration="2.119108565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:51:12.118394238 +0000 UTC m=+1531.813950331" watchObservedRunningTime="2026-07-27 19:51:12.119108565 +0000 UTC m=+1531.814664662"
Jul 27 19:51:13.968750 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:13.968715    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:51:21.013536 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:21.013437    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:21.013536 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:21.013498    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:21.026117 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:21.026090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:21.161369 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:21.161339    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:51:26.862339 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:26.862306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:51:48.739325 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:48.739293    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"]
Jul 27 19:51:52.656031 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:51:52.655990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:52:03.759588 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:03.759543    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86" podUID="d8c97802-0be2-412b-b4c3-351ecdede0c5" containerName="main" containerID="cri-o://b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e" gracePeriod=45
Jul 27 19:52:04.016368 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.016300    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:52:04.117750 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.117714    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-home\") pod \"d8c97802-0be2-412b-b4c3-351ecdede0c5\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") "
Jul 27 19:52:04.118011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.117768    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-model-cache\") pod \"d8c97802-0be2-412b-b4c3-351ecdede0c5\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") "
Jul 27 19:52:04.118011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.117806    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4mlf\" (UniqueName: \"kubernetes.io/projected/d8c97802-0be2-412b-b4c3-351ecdede0c5-kube-api-access-l4mlf\") pod \"d8c97802-0be2-412b-b4c3-351ecdede0c5\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") "
Jul 27 19:52:04.118011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.117831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c97802-0be2-412b-b4c3-351ecdede0c5-tls-certs\") pod \"d8c97802-0be2-412b-b4c3-351ecdede0c5\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") "
Jul 27 19:52:04.118011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.117892    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-tmp-dir\") pod \"d8c97802-0be2-412b-b4c3-351ecdede0c5\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") "
Jul 27 19:52:04.118011 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.117970    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-dshm\") pod \"d8c97802-0be2-412b-b4c3-351ecdede0c5\" (UID: \"d8c97802-0be2-412b-b4c3-351ecdede0c5\") "
Jul 27 19:52:04.118365 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.118039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-home" (OuterVolumeSpecName: "home") pod "d8c97802-0be2-412b-b4c3-351ecdede0c5" (UID: "d8c97802-0be2-412b-b4c3-351ecdede0c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:52:04.118365 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.118234    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-home\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:52:04.118471 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.118438    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8c97802-0be2-412b-b4c3-351ecdede0c5" (UID: "d8c97802-0be2-412b-b4c3-351ecdede0c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:52:04.118564 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.118540    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8c97802-0be2-412b-b4c3-351ecdede0c5" (UID: "d8c97802-0be2-412b-b4c3-351ecdede0c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:52:04.120304 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.120276    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c97802-0be2-412b-b4c3-351ecdede0c5-kube-api-access-l4mlf" (OuterVolumeSpecName: "kube-api-access-l4mlf") pod "d8c97802-0be2-412b-b4c3-351ecdede0c5" (UID: "d8c97802-0be2-412b-b4c3-351ecdede0c5"). InnerVolumeSpecName "kube-api-access-l4mlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:52:04.120469 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.120448    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-dshm" (OuterVolumeSpecName: "dshm") pod "d8c97802-0be2-412b-b4c3-351ecdede0c5" (UID: "d8c97802-0be2-412b-b4c3-351ecdede0c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:52:04.120532 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.120450    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8c97802-0be2-412b-b4c3-351ecdede0c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8c97802-0be2-412b-b4c3-351ecdede0c5" (UID: "d8c97802-0be2-412b-b4c3-351ecdede0c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:52:04.219253 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.219212    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4mlf\" (UniqueName: \"kubernetes.io/projected/d8c97802-0be2-412b-b4c3-351ecdede0c5-kube-api-access-l4mlf\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:52:04.219253 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.219244    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c97802-0be2-412b-b4c3-351ecdede0c5-tls-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:52:04.219479 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.219272    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-tmp-dir\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:52:04.219479 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.219284    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-dshm\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:52:04.219479 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.219296    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c97802-0be2-412b-b4c3-351ecdede0c5-model-cache\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:52:04.366150 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.366058    2559 generic.go:356] "Generic (PLEG): container finished" podID="d8c97802-0be2-412b-b4c3-351ecdede0c5" containerID="b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e" exitCode=0
Jul 27 19:52:04.366150 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.366113    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"
Jul 27 19:52:04.366381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.366146    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86" event={"ID":"d8c97802-0be2-412b-b4c3-351ecdede0c5","Type":"ContainerDied","Data":"b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e"}
Jul 27 19:52:04.366381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.366197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86" event={"ID":"d8c97802-0be2-412b-b4c3-351ecdede0c5","Type":"ContainerDied","Data":"c13c2f0f9bc1ae3d633fc0e2a35286e639e151eebb61a633855562f8ac75a7c5"}
Jul 27 19:52:04.366381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.366221    2559 scope.go:117] "RemoveContainer" containerID="b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e"
Jul 27 19:52:04.375674 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.375653    2559 scope.go:117] "RemoveContainer" containerID="b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e"
Jul 27 19:52:04.375962 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:52:04.375940    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e\": container with ID starting with b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e not found: ID does not exist" containerID="b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e"
Jul 27 19:52:04.376022 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.375974    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e"} err="failed to get container status \"b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e\": rpc error: code = NotFound desc = could not find container \"b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e\": container with ID starting with b39158e330fc039a1fa1019e1869b7555d1ef89890f4095bdd56c117c0de2b5e not found: ID does not exist"
Jul 27 19:52:04.386307 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.386287    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"]
Jul 27 19:52:04.389497 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.389477    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-f3c3fead-kserve-594b6cb495-mfz86"]
Jul 27 19:52:04.942124 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:04.942092    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8c97802-0be2-412b-b4c3-351ecdede0c5" path="/var/lib/kubelet/pods/d8c97802-0be2-412b-b4c3-351ecdede0c5/volumes"
Jul 27 19:52:06.967949 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:06.967914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:52:13.855685 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:13.855651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:52:29.859175 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:29.859139    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:52:39.866734 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:39.866638    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:52:49.656795 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:49.656762    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:52:57.067909 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:52:57.067870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:53:06.770643 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:53:06.770596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:53:16.465978 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:53:16.465937    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:53:29.863227 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:53:29.863195    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:53:39.557138 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:53:39.557097    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:53:49.864459 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:53:49.864423    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:54:02.461639 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:54:02.461559    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:54:11.760623 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:54:11.760587    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:54:18.372410 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:54:18.372368    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:54:34.657088 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:54:34.657047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:54:44.061475 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:54:44.061435    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:54:54.061033 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:54:54.060997    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:55:02.370253 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:02.370217    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:55:12.072145 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:12.072107    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:55:22.860276 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:22.860238    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:55:36.155208 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:36.155129    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:55:40.843835 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.843803    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"]
Jul 27 19:55:40.844216 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.844204    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8c97802-0be2-412b-b4c3-351ecdede0c5" containerName="main"
Jul 27 19:55:40.844216 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.844216    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8c97802-0be2-412b-b4c3-351ecdede0c5" containerName="main"
Jul 27 19:55:40.844290 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.844285    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8c97802-0be2-412b-b4c3-351ecdede0c5" containerName="main"
Jul 27 19:55:40.847316 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.847299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.849791 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.849765    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6154550c-openshift-default-dockercfg-6gsk4\""
Jul 27 19:55:40.867190 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.867167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"]
Jul 27 19:55:40.918229 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.918200    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:55:40.920722 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.920699    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 19:55:40.925244 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.923269    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:55:40.929661 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.929636    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 19:55:40.977929 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.977895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/607c2963-7017-4231-b785-7f006851d12e-istiod-ca-cert\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978096 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.977937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-istio-token\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978096 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.977998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw5df\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-kube-api-access-kw5df\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978096 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.978029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-credential-socket\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978096 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.978049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/607c2963-7017-4231-b785-7f006851d12e-istio-podinfo\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978096 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.978084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-envoy\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978263 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.978159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-socket\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978263 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.978200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-certs\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:40.978263 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:40.978217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-data\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079202 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-socket\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-certs\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-data\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/607c2963-7017-4231-b785-7f006851d12e-istiod-ca-cert\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-istio-token\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079381 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw5df\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-kube-api-access-kw5df\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-credential-socket\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/607c2963-7017-4231-b785-7f006851d12e-istio-podinfo\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079613 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-envoy\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079769 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079626    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-socket\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079769 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-certs\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079769 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-data\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.079979 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.079932    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-credential-socket\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.080038 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.080012    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/607c2963-7017-4231-b785-7f006851d12e-istiod-ca-cert\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.081869 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.081830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-envoy\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.081970 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.081933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/607c2963-7017-4231-b785-7f006851d12e-istio-podinfo\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.087413 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.087387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-istio-token\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.087512 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.087498    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw5df\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-kube-api-access-kw5df\") pod \"e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") " pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.159391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.159297    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:41.307972 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.307948    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"]
Jul 27 19:55:41.311419 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:55:41.311374    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607c2963_7017_4231_b785_7f006851d12e.slice/crio-dae1d67ffa3f4bb65ce31f24c93bb53c47c787b6279722d411076d7a3cb9e926 WatchSource:0}: Error finding container dae1d67ffa3f4bb65ce31f24c93bb53c47c787b6279722d411076d7a3cb9e926: Status 404 returned error can't find the container with id dae1d67ffa3f4bb65ce31f24c93bb53c47c787b6279722d411076d7a3cb9e926
Jul 27 19:55:41.313844 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.313798    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:55:41.313961 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.313930    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:55:41.314002 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.313978    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:55:41.425771 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.425573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" event={"ID":"607c2963-7017-4231-b785-7f006851d12e","Type":"ContainerStarted","Data":"9fb287ad7013bff6b8d10017ad3318c42fee0f7bb5b283c7d0aa684303ede15e"}
Jul 27 19:55:41.426000 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.425836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" event={"ID":"607c2963-7017-4231-b785-7f006851d12e","Type":"ContainerStarted","Data":"dae1d67ffa3f4bb65ce31f24c93bb53c47c787b6279722d411076d7a3cb9e926"}
Jul 27 19:55:41.449428 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:41.449375    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" podStartSLOduration=1.449357512 podStartE2EDuration="1.449357512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:41.447391186 +0000 UTC m=+1801.142947284" watchObservedRunningTime="2026-07-27 19:55:41.449357512 +0000 UTC m=+1801.144913605"
Jul 27 19:55:42.160503 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:42.160463    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:42.165159 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:42.165133    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:42.430690 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:42.430656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:42.431723 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:42.431705    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:46.665621 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:46.665584    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:55:55.504692 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:55.504657    2559 generic.go:356] "Generic (PLEG): container finished" podID="607c2963-7017-4231-b785-7f006851d12e" containerID="9fb287ad7013bff6b8d10017ad3318c42fee0f7bb5b283c7d0aa684303ede15e" exitCode=0
Jul 27 19:55:55.505122 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:55.504724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" event={"ID":"607c2963-7017-4231-b785-7f006851d12e","Type":"ContainerDied","Data":"9fb287ad7013bff6b8d10017ad3318c42fee0f7bb5b283c7d0aa684303ede15e"}
Jul 27 19:55:55.505229 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:55.505213    2559 scope.go:117] "RemoveContainer" containerID="9fb287ad7013bff6b8d10017ad3318c42fee0f7bb5b283c7d0aa684303ede15e"
Jul 27 19:55:55.506319 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:55.506293    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:55:55.506392 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:55.506358    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:55:55.506429 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:55.506390    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:55:56.519887 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:56.519830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" event={"ID":"607c2963-7017-4231-b785-7f006851d12e","Type":"ContainerStarted","Data":"a6fb8fc199ad5fae855885082549e5b53a9fc1e3d36f19e8d986bbcfda3f745d"}
Jul 27 19:55:57.159936 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:57.159893    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:57.161182 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:57.161157    2559 patch_prober.go:28] interesting pod/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 27 19:55:57.161287 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:57.161206    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 27 19:55:57.430595 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:57.430559    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:55:58.160601 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:58.160566    2559 patch_prober.go:28] interesting pod/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 27 19:55:58.160971 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:58.160621    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 27 19:55:59.160104 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:59.160065    2559 patch_prober.go:28] interesting pod/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 27 19:55:59.160268 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:55:59.160135    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 27 19:56:00.160028 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:00.159994    2559 patch_prober.go:28] interesting pod/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 27 19:56:00.160499 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:00.160046    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 27 19:56:01.163768 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:01.163736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:56:01.164714 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:01.164693    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:56:21.761263 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:21.761224    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:56:23.523841 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:23.523809    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"]
Jul 27 19:56:23.524312 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:23.524121    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy" containerID="cri-o://a6fb8fc199ad5fae855885082549e5b53a9fc1e3d36f19e8d986bbcfda3f745d" gracePeriod=30
Jul 27 19:56:24.519231 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.519194    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"]
Jul 27 19:56:24.522830 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.522810    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.525161 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.525136    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c241bf21-gw-openshift-default-dockercfg-sft9p\""
Jul 27 19:56:24.536800 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.536776    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"]
Jul 27 19:56:24.680067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680036    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-credential-socket\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680067 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-envoy\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istiod-ca-cert\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhzct\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-kube-api-access-vhzct\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-data\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-podinfo\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-certs\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680300 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-token\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.680532 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.680376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-socket\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781080 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.780983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-data\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781080 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-podinfo\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781080 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-certs\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781080 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-token\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-socket\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781137    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-credential-socket\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-envoy\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istiod-ca-cert\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781421 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhzct\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-kube-api-access-vhzct\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781646 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-certs\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-data\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781676    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-socket\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.781816 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-credential-socket\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.782008 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.781990    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istiod-ca-cert\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.783431 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.783409    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-envoy\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.783539 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.783518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-podinfo\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.788318 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.788291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-token\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.788599 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.788581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhzct\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-kube-api-access-vhzct\") pod \"e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") " pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.834354 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.834310    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:24.992821 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.992790    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"]
Jul 27 19:56:24.994058 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:56:24.994030    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905a5b0d_4cab_478c_9aeb_eb3d3b0ac59b.slice/crio-c734c38ec108ae0e3d37fcbb721598f677eadf124c4ca0bfb6969afe1499202d WatchSource:0}: Error finding container c734c38ec108ae0e3d37fcbb721598f677eadf124c4ca0bfb6969afe1499202d: Status 404 returned error can't find the container with id c734c38ec108ae0e3d37fcbb721598f677eadf124c4ca0bfb6969afe1499202d
Jul 27 19:56:24.996169 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.996125    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:56:24.996241 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.996222    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:56:24.996289 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:24.996273    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:56:25.670385 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:25.670349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" event={"ID":"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b","Type":"ContainerStarted","Data":"6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972"}
Jul 27 19:56:25.670801 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:25.670411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" event={"ID":"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b","Type":"ContainerStarted","Data":"c734c38ec108ae0e3d37fcbb721598f677eadf124c4ca0bfb6969afe1499202d"}
Jul 27 19:56:25.691095 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:25.691046    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" podStartSLOduration=1.691031222 podStartE2EDuration="1.691031222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:25.689800002 +0000 UTC m=+1845.385356096" watchObservedRunningTime="2026-07-27 19:56:25.691031222 +0000 UTC m=+1845.386587391"
Jul 27 19:56:25.835042 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:25.835003    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:26.839556 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:26.839524    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:27.681575 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:27.681544    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:27.682515 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:27.682499    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:28.689058 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.689019    2559 generic.go:356] "Generic (PLEG): container finished" podID="607c2963-7017-4231-b785-7f006851d12e" containerID="a6fb8fc199ad5fae855885082549e5b53a9fc1e3d36f19e8d986bbcfda3f745d" exitCode=0
Jul 27 19:56:28.689538 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.689063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" event={"ID":"607c2963-7017-4231-b785-7f006851d12e","Type":"ContainerDied","Data":"a6fb8fc199ad5fae855885082549e5b53a9fc1e3d36f19e8d986bbcfda3f745d"}
Jul 27 19:56:28.689538 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.689137    2559 scope.go:117] "RemoveContainer" containerID="9fb287ad7013bff6b8d10017ad3318c42fee0f7bb5b283c7d0aa684303ede15e"
Jul 27 19:56:28.811103 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.811072    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:56:28.924664 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924630    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-envoy\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.924886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924673    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-istio-token\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.924886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924705    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-data\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.924886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924751    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/607c2963-7017-4231-b785-7f006851d12e-istiod-ca-cert\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.924886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924784    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-certs\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.924886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924828    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/607c2963-7017-4231-b785-7f006851d12e-istio-podinfo\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.925175 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924890    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-credential-socket\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.925175 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924918    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw5df\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-kube-api-access-kw5df\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.925175 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.924945    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-socket\") pod \"607c2963-7017-4231-b785-7f006851d12e\" (UID: \"607c2963-7017-4231-b785-7f006851d12e\") "
Jul 27 19:56:28.925175 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925121    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:28.925393 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925203    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/607c2963-7017-4231-b785-7f006851d12e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:28.925393 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925299    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:28.925507 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925433    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:28.925573 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925555    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/607c2963-7017-4231-b785-7f006851d12e-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.925631 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925580    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.925631 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925594    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.925631 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925609    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.925759 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.925679    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-data" (OuterVolumeSpecName: "istio-data") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:28.927026 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.926999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:56:28.927122 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.927050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-istio-token" (OuterVolumeSpecName: "istio-token") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:28.927492 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.927474    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-kube-api-access-kw5df" (OuterVolumeSpecName: "kube-api-access-kw5df") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "kube-api-access-kw5df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:28.927551 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:28.927482    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/607c2963-7017-4231-b785-7f006851d12e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "607c2963-7017-4231-b785-7f006851d12e" (UID: "607c2963-7017-4231-b785-7f006851d12e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:56:29.026286 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.026253    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/607c2963-7017-4231-b785-7f006851d12e-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:29.026286 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.026281    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw5df\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-kube-api-access-kw5df\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:29.026286 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.026290    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:29.026641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.026300    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/607c2963-7017-4231-b785-7f006851d12e-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:29.026641 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.026308    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/607c2963-7017-4231-b785-7f006851d12e-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:56:29.695227 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.695198    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"
Jul 27 19:56:29.695630 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.695242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq" event={"ID":"607c2963-7017-4231-b785-7f006851d12e","Type":"ContainerDied","Data":"dae1d67ffa3f4bb65ce31f24c93bb53c47c787b6279722d411076d7a3cb9e926"}
Jul 27 19:56:29.695630 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.695300    2559 scope.go:117] "RemoveContainer" containerID="a6fb8fc199ad5fae855885082549e5b53a9fc1e3d36f19e8d986bbcfda3f745d"
Jul 27 19:56:29.713963 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.713926    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"]
Jul 27 19:56:29.717399 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:29.717370    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6154550c-openshift-default-5d6f67f4c8-g9brq"]
Jul 27 19:56:30.941389 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:30.941356    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="607c2963-7017-4231-b785-7f006851d12e" path="/var/lib/kubelet/pods/607c2963-7017-4231-b785-7f006851d12e/volumes"
Jul 27 19:56:32.755886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:32.755840    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:56:40.762489 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:40.762413    2559 generic.go:356] "Generic (PLEG): container finished" podID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerID="6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972" exitCode=0
Jul 27 19:56:40.762912 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:40.762479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" event={"ID":"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b","Type":"ContainerDied","Data":"6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972"}
Jul 27 19:56:40.762912 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:40.762836    2559 scope.go:117] "RemoveContainer" containerID="6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972"
Jul 27 19:56:40.763788 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:40.763761    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:56:40.763892 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:40.763838    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:56:40.763963 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:40.763920    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:56:41.769423 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:41.769382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" event={"ID":"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b","Type":"ContainerStarted","Data":"ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c"}
Jul 27 19:56:41.834720 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:41.834673    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:41.835747 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:41.835716    2559 patch_prober.go:28] interesting pod/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:56:41.835898 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:41.835782    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:56:42.681800 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:42.681763    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:42.834635 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:42.834594    2559 patch_prober.go:28] interesting pod/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:56:42.835183 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:42.834658    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:56:43.834938 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:43.834901    2559 patch_prober.go:28] interesting pod/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:56:43.835329 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:43.834961    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:56:44.835018 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:44.834983    2559 patch_prober.go:28] interesting pod/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 19:56:44.835509 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:44.835047    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 19:56:45.839069 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:45.839039    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:56:45.839945 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:56:45.839919    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:57:05.361173 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:05.361085    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:57:07.316091 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:07.316051    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"]
Jul 27 19:57:07.316526 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:07.316369    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy" containerID="cri-o://ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c" gracePeriod=30
Jul 27 19:57:08.054788 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.054755    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"]
Jul 27 19:57:08.055283 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.055265    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy"
Jul 27 19:57:08.055283 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.055284    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy"
Jul 27 19:57:08.055408 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.055350    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy"
Jul 27 19:57:08.058662 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.058646    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.060927 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.060906    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3ace1558-openshift-default-dockercfg-7rcp5\""
Jul 27 19:57:08.068843 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.068822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"]
Jul 27 19:57:08.190124 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mrkh\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-kube-api-access-8mrkh\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190312 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-certs\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190312 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-socket\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190312 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-credential-socket\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-data\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istiod-ca-cert\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-envoy\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190451 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-token\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.190583 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.190513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-podinfo\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291023 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.290981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-socket\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291222 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-credential-socket\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291222 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-data\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291222 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291099    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istiod-ca-cert\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291397 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-envoy\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291397 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-token\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291397 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291320    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-podinfo\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291397 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mrkh\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-kube-api-access-8mrkh\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291607 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-certs\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291607 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291477    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-socket\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291717 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-credential-socket\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291777 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291710    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-data\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.291831 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291784    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istiod-ca-cert\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.292010 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.291987    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-certs\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.293570 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.293547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-envoy\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.293953 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.293932    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-podinfo\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.299246 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.299224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-token\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.299522 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.299499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mrkh\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-kube-api-access-8mrkh\") pod \"e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") " pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.368932 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.368814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:08.510823 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.510784    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"]
Jul 27 19:57:08.512146 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:57:08.512119    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf787c39f_54f1_4ea6_8f72_09cc8602d4e1.slice/crio-0aa1e3fd8d681cfc1eb1be661e48aaac5e6e793d0c2be8890af56f02f383c4ca WatchSource:0}: Error finding container 0aa1e3fd8d681cfc1eb1be661e48aaac5e6e793d0c2be8890af56f02f383c4ca: Status 404 returned error can't find the container with id 0aa1e3fd8d681cfc1eb1be661e48aaac5e6e793d0c2be8890af56f02f383c4ca
Jul 27 19:57:08.514492 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.514447    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:08.514582 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.514544    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:08.514622 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.514589    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:08.908986 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.908938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" event={"ID":"f787c39f-54f1-4ea6-8f72-09cc8602d4e1","Type":"ContainerStarted","Data":"df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42"}
Jul 27 19:57:08.909186 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.909005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" event={"ID":"f787c39f-54f1-4ea6-8f72-09cc8602d4e1","Type":"ContainerStarted","Data":"0aa1e3fd8d681cfc1eb1be661e48aaac5e6e793d0c2be8890af56f02f383c4ca"}
Jul 27 19:57:08.927706 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:08.927650    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" podStartSLOduration=0.927632265 podStartE2EDuration="927.632265ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:08.925911562 +0000 UTC m=+1888.621467657" watchObservedRunningTime="2026-07-27 19:57:08.927632265 +0000 UTC m=+1888.623188359"
Jul 27 19:57:09.369316 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:09.369280    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:09.374509 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:09.374485    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:09.914483 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:09.914449    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:09.915396 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:09.915376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:12.572365 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.572341    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:57:12.736109 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736069    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istiod-ca-cert\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736109 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736109    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-data\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-socket\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736169    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhzct\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-kube-api-access-vhzct\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736198    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-certs\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-podinfo\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736266    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-credential-socket\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736313    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-token\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736359    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-envoy\") pod \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\" (UID: \"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b\") "
Jul 27 19:57:12.736722 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736493    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:12.736722 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736631    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:12.736722 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736642    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:12.736722 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736555    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:12.736964 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736792    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.736964 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736807    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.736964 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736818    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.736964 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.736826    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.737343 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.737316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-data" (OuterVolumeSpecName: "istio-data") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:12.738747 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.738710    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:12.738902 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.738752    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-kube-api-access-vhzct" (OuterVolumeSpecName: "kube-api-access-vhzct") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "kube-api-access-vhzct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:12.738986 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.738961    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:57:12.739047 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.738963    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-token" (OuterVolumeSpecName: "istio-token") pod "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" (UID: "905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:12.837909 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.837877    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.837909 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.837910    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhzct\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-kube-api-access-vhzct\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.838109 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.837923    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.838109 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.837931    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.838109 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.837939    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:12.934709 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.934673    2559 generic.go:356] "Generic (PLEG): container finished" podID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerID="ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c" exitCode=0
Jul 27 19:57:12.934910 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.934717    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"
Jul 27 19:57:12.934910 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.934756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" event={"ID":"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b","Type":"ContainerDied","Data":"ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c"}
Jul 27 19:57:12.934910 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.934814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc" event={"ID":"905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b","Type":"ContainerDied","Data":"c734c38ec108ae0e3d37fcbb721598f677eadf124c4ca0bfb6969afe1499202d"}
Jul 27 19:57:12.934910 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.934841    2559 scope.go:117] "RemoveContainer" containerID="ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c"
Jul 27 19:57:12.944909 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.944847    2559 scope.go:117] "RemoveContainer" containerID="6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972"
Jul 27 19:57:12.953344 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.953325    2559 scope.go:117] "RemoveContainer" containerID="ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c"
Jul 27 19:57:12.953605 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:57:12.953588    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c\": container with ID starting with ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c not found: ID does not exist" containerID="ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c"
Jul 27 19:57:12.953677 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.953616    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c"} err="failed to get container status \"ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c\": rpc error: code = NotFound desc = could not find container \"ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c\": container with ID starting with ecee2bfc88002e2f6bd91f070b5ccee727c5272b277a475505bfe1232badb11c not found: ID does not exist"
Jul 27 19:57:12.953677 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.953641    2559 scope.go:117] "RemoveContainer" containerID="6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972"
Jul 27 19:57:12.953879 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:57:12.953845    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972\": container with ID starting with 6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972 not found: ID does not exist" containerID="6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972"
Jul 27 19:57:12.953930 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.953882    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972"} err="failed to get container status \"6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972\": rpc error: code = NotFound desc = could not find container \"6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972\": container with ID starting with 6c9e2d5b09c05b86d5ba959336e4d29156ded56a7d978a7edbe5a02e5a6fc972 not found: ID does not exist"
Jul 27 19:57:12.959154 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.959132    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"]
Jul 27 19:57:12.962252 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:12.962234    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c241bf21-gw-openshift-default-846c945668-8hjrc"]
Jul 27 19:57:14.944052 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:14.942256    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" path="/var/lib/kubelet/pods/905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b/volumes"
Jul 27 19:57:16.466204 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:16.466165    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:57:23.997221 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:23.997186    2559 generic.go:356] "Generic (PLEG): container finished" podID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerID="df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42" exitCode=0
Jul 27 19:57:23.997670 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:23.997254    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" event={"ID":"f787c39f-54f1-4ea6-8f72-09cc8602d4e1","Type":"ContainerDied","Data":"df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42"}
Jul 27 19:57:23.997769 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:23.997754    2559 scope.go:117] "RemoveContainer" containerID="df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42"
Jul 27 19:57:23.998940 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:23.998913    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:23.999007 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:23.998977    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:23.999044 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:23.999007    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:24.914825 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:24.914728    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:25.003661 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:25.003623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" event={"ID":"f787c39f-54f1-4ea6-8f72-09cc8602d4e1","Type":"ContainerStarted","Data":"a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736"}
Jul 27 19:57:25.369832 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:25.369789    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:25.371068 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:25.371041    2559 patch_prober.go:28] interesting pod/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 19:57:25.371195 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:25.371088    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 19:57:26.369328 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:26.369292    2559 patch_prober.go:28] interesting pod/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 19:57:26.369728 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:26.369351    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 19:57:27.369832 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:27.369795    2559 patch_prober.go:28] interesting pod/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 19:57:27.370216 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:27.369884    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 19:57:28.370313 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:28.370273    2559 patch_prober.go:28] interesting pod/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 27 19:57:28.370726 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:28.370345    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 27 19:57:29.373189 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:29.373154    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:29.373559 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:29.373417    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:29.374069 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:29.374050    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:49.666743 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:49.666708    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:57:52.310736 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:52.310698    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"]
Jul 27 19:57:52.311241 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:52.310977    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy" containerID="cri-o://a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736" gracePeriod=30
Jul 27 19:57:53.029657 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.029620    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"]
Jul 27 19:57:53.030156 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.030122    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy"
Jul 27 19:57:53.030701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.030168    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy"
Jul 27 19:57:53.030701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.030214    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy"
Jul 27 19:57:53.030701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.030224    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy"
Jul 27 19:57:53.030701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.030345    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy"
Jul 27 19:57:53.030701 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.030360    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="607c2963-7017-4231-b785-7f006851d12e" containerName="istio-proxy"
Jul 27 19:57:53.033670 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.033649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.035805 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.035782    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-6ac18d4b-openshift-default-dockercfg-r2rf6\""
Jul 27 19:57:53.044355 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.044326    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"]
Jul 27 19:57:53.204813 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.204775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnfgz\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-kube-api-access-lnfgz\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205042 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.204821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-certs\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205042 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.204845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-token\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205042 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.204944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istiod-ca-cert\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205042 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.205016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-socket\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205279 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.205066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-envoy\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205279 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.205113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-data\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205279 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.205166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-credential-socket\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.205279 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.205204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-podinfo\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306580 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-token\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306580 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istiod-ca-cert\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306580 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-socket\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306896 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306687    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-envoy\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306896 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-data\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306896 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-credential-socket\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306896 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-podinfo\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.306896 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfgz\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-kube-api-access-lnfgz\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.307161 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-certs\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.307161 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.306978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-socket\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.307266 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.307204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-credential-socket\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.307335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.307269    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-certs\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.307335 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.307311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-data\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.307946 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.307921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istiod-ca-cert\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.309199 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.309175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-envoy\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.309540 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.309518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-podinfo\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.317132 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.317107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-token\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.317401 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.317300    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfgz\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-kube-api-access-lnfgz\") pod \"e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") " pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.344823 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.344803    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:53.487768 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.487737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"]
Jul 27 19:57:53.491067 ip-10-0-131-166 kubenswrapper[2559]: W0727 19:57:53.491037    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode837ca8c_4865_47b6_9b7e_0fc746d3b7f0.slice/crio-3ae6256719f1fba21e9733ef7bb787246fc7d58ed668af7f7e49f99950a7974e WatchSource:0}: Error finding container 3ae6256719f1fba21e9733ef7bb787246fc7d58ed668af7f7e49f99950a7974e: Status 404 returned error can't find the container with id 3ae6256719f1fba21e9733ef7bb787246fc7d58ed668af7f7e49f99950a7974e
Jul 27 19:57:53.493060 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.493026    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:53.493144 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.493087    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:53.493144 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:53.493117    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:57:54.165480 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:54.165439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" event={"ID":"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0","Type":"ContainerStarted","Data":"bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62"}
Jul 27 19:57:54.165665 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:54.165504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" event={"ID":"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0","Type":"ContainerStarted","Data":"3ae6256719f1fba21e9733ef7bb787246fc7d58ed668af7f7e49f99950a7974e"}
Jul 27 19:57:54.187652 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:54.187605    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" podStartSLOduration=1.18758986 podStartE2EDuration="1.18758986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:54.186176747 +0000 UTC m=+1933.881732842" watchObservedRunningTime="2026-07-27 19:57:54.18758986 +0000 UTC m=+1933.883145953"
Jul 27 19:57:54.345027 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:54.344987    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:54.349879 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:54.349832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:55.170301 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:55.170271    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:55.171441 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:55.171419    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:57:57.569886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.569842    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:57.748484 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748450    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istiod-ca-cert\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.748484 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748488    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-envoy\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.748737 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748541    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-data\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.748737 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748581    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mrkh\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-kube-api-access-8mrkh\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.748737 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-certs\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.748737 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748642    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-credential-socket\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.748737 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748665    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-token\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.748737 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-socket\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.749083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748799    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-podinfo\") pod \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\" (UID: \"f787c39f-54f1-4ea6-8f72-09cc8602d4e1\") "
Jul 27 19:57:57.749083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.748988    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:57.749083 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.749038    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:57.749240 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.749091    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:57:57.749322 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.749303    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.749382 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.749318    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:57.749382 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.749330    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.749382 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.749345    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.749737 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.749713    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:57.751168 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.751138    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-kube-api-access-8mrkh" (OuterVolumeSpecName: "kube-api-access-8mrkh") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "kube-api-access-8mrkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:57.751264 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.751198    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:57.751339 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.751321    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:57.751393 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.751348    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f787c39f-54f1-4ea6-8f72-09cc8602d4e1" (UID: "f787c39f-54f1-4ea6-8f72-09cc8602d4e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:57:57.850627 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.850592    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.850627 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.850622    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.850627 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.850631    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.850886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.850639    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.850886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.850648    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mrkh\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-kube-api-access-8mrkh\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:57.850886 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:57.850657    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f787c39f-54f1-4ea6-8f72-09cc8602d4e1-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:57:58.185974 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.185945    2559 generic.go:356] "Generic (PLEG): container finished" podID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerID="a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736" exitCode=0
Jul 27 19:57:58.186133 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.185986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" event={"ID":"f787c39f-54f1-4ea6-8f72-09cc8602d4e1","Type":"ContainerDied","Data":"a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736"}
Jul 27 19:57:58.186133 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.186002    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"
Jul 27 19:57:58.186133 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.186032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz" event={"ID":"f787c39f-54f1-4ea6-8f72-09cc8602d4e1","Type":"ContainerDied","Data":"0aa1e3fd8d681cfc1eb1be661e48aaac5e6e793d0c2be8890af56f02f383c4ca"}
Jul 27 19:57:58.186133 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.186055    2559 scope.go:117] "RemoveContainer" containerID="a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736"
Jul 27 19:57:58.197789 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.197767    2559 scope.go:117] "RemoveContainer" containerID="df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42"
Jul 27 19:57:58.205647 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.205625    2559 scope.go:117] "RemoveContainer" containerID="a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736"
Jul 27 19:57:58.206001 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:57:58.205974    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736\": container with ID starting with a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736 not found: ID does not exist" containerID="a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736"
Jul 27 19:57:58.206102 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.206011    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736"} err="failed to get container status \"a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736\": rpc error: code = NotFound desc = could not find container \"a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736\": container with ID starting with a4d344b44f0a187a925d5144f86e64b747a7715345d910caa2504153bc768736 not found: ID does not exist"
Jul 27 19:57:58.206102 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.206036    2559 scope.go:117] "RemoveContainer" containerID="df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42"
Jul 27 19:57:58.206586 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:57:58.206520    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42\": container with ID starting with df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42 not found: ID does not exist" containerID="df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42"
Jul 27 19:57:58.206586 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.206556    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42"} err="failed to get container status \"df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42\": rpc error: code = NotFound desc = could not find container \"df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42\": container with ID starting with df6795df18077d0deb6652389ca02ca15d0a7d1914bad0c2e87c60ec7952cf42 not found: ID does not exist"
Jul 27 19:57:58.209167 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.209140    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"]
Jul 27 19:57:58.212765 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.212745    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3ace1558-openshift-default-58455b54f8-xjnvz"]
Jul 27 19:57:58.867264 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.867232    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:57:58.942771 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:57:58.942738    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" path="/var/lib/kubelet/pods/f787c39f-54f1-4ea6-8f72-09cc8602d4e1/volumes"
Jul 27 19:58:07.244160 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:07.244129    2559 generic.go:356] "Generic (PLEG): container finished" podID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerID="bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62" exitCode=0
Jul 27 19:58:07.244578 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:07.244175    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" event={"ID":"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0","Type":"ContainerDied","Data":"bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62"}
Jul 27 19:58:07.244578 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:07.244528    2559 scope.go:117] "RemoveContainer" containerID="bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62"
Jul 27 19:58:07.245502 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:07.245472    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:58:07.245548 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:07.245539    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:58:07.245588 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:07.245576    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 19:58:08.250904 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:08.250840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" event={"ID":"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0","Type":"ContainerStarted","Data":"19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57"}
Jul 27 19:58:08.345019 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:08.344981    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:58:08.345964 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:08.345941    2559 patch_prober.go:28] interesting pod/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 27 19:58:08.346071 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:08.345994    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 27 19:58:09.346209 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:09.346167    2559 patch_prober.go:28] interesting pod/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 27 19:58:09.346689 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:09.346242    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 27 19:58:10.171187 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:10.171149    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:58:10.345394 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:10.345359    2559 patch_prober.go:28] interesting pod/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 27 19:58:10.345569 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:10.345429    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 27 19:58:11.346073 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:11.346038    2559 patch_prober.go:28] interesting pod/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Jul 27 19:58:11.346492 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:11.346105    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Jul 27 19:58:12.349106 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:12.349074    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:58:12.350157 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:12.350132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:58:33.458452 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:33.458375    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 19:58:35.598425 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:35.598392    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"]
Jul 27 19:58:35.607391 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:35.607094    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy" containerID="cri-o://19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57" gracePeriod=30
Jul 27 19:58:40.874403 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.874340    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:58:40.975611 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975581    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istiod-ca-cert\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.975611 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975614    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-credential-socket\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.975811 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975632    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-podinfo\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.975811 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975694    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnfgz\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-kube-api-access-lnfgz\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.975811 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-envoy\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.975811 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975733    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-certs\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.975811 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975760    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-socket\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.975811 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975783    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-token\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.976212 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975838    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-data\") pod \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\" (UID: \"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0\") "
Jul 27 19:58:40.976212 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.975879    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:40.976212 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.976050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:40.976212 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.976059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:40.976417 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.976244    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:40.976417 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.976265    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:40.976417 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.976246    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:40.976417 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.976299    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:40.977111 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.977089    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:40.977997 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.977974    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 19:58:40.978110 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.978095    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-kube-api-access-lnfgz" (OuterVolumeSpecName: "kube-api-access-lnfgz") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "kube-api-access-lnfgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:40.978331 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.978308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:58:40.978429 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:40.978336    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" (UID: "e837ca8c-4865-47b6-9b7e-0fc746d3b7f0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:41.076781 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.076746    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnfgz\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-kube-api-access-lnfgz\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.076781 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.076780    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.076999 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.076790    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.076999 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.076800    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.076999 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.076808    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.076999 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.076816    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.411807 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.411761    2559 generic.go:356] "Generic (PLEG): container finished" podID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerID="19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57" exitCode=0
Jul 27 19:58:41.411807 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.411799    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" event={"ID":"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0","Type":"ContainerDied","Data":"19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57"}
Jul 27 19:58:41.412085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.411825    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"
Jul 27 19:58:41.412085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.411874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng" event={"ID":"e837ca8c-4865-47b6-9b7e-0fc746d3b7f0","Type":"ContainerDied","Data":"3ae6256719f1fba21e9733ef7bb787246fc7d58ed668af7f7e49f99950a7974e"}
Jul 27 19:58:41.412085 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.411900    2559 scope.go:117] "RemoveContainer" containerID="19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57"
Jul 27 19:58:41.421482 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.421423    2559 scope.go:117] "RemoveContainer" containerID="bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62"
Jul 27 19:58:41.429519 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.429504    2559 scope.go:117] "RemoveContainer" containerID="19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57"
Jul 27 19:58:41.429767 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:58:41.429747    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57\": container with ID starting with 19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57 not found: ID does not exist" containerID="19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57"
Jul 27 19:58:41.429827 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.429775    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57"} err="failed to get container status \"19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57\": rpc error: code = NotFound desc = could not find container \"19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57\": container with ID starting with 19e8b2f437cce5217324b516003ccd715b4a7951ed89f7893817c3aec0c11c57 not found: ID does not exist"
Jul 27 19:58:41.429827 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.429792    2559 scope.go:117] "RemoveContainer" containerID="bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62"
Jul 27 19:58:41.430041 ip-10-0-131-166 kubenswrapper[2559]: E0727 19:58:41.430025    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62\": container with ID starting with bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62 not found: ID does not exist" containerID="bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62"
Jul 27 19:58:41.430086 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.430048    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62"} err="failed to get container status \"bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62\": rpc error: code = NotFound desc = could not find container \"bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62\": container with ID starting with bfa9e1e76088958464c33a8f30de3fee1fcd0617c4d5aa80c77f6ef847373b62 not found: ID does not exist"
Jul 27 19:58:41.434571 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.434550    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"]
Jul 27 19:58:41.437377 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:41.437346    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-6ac18d4b-openshift-default-6d47b58fc6-bvkng"]
Jul 27 19:58:42.941567 ip-10-0-131-166 kubenswrapper[2559]: I0727 19:58:42.941531    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" path="/var/lib/kubelet/pods/e837ca8c-4865-47b6-9b7e-0fc746d3b7f0/volumes"
Jul 27 20:00:01.171567 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:01.171527    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:00:11.458509 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:11.458467    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:00:13.959135 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959100    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"]
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959490    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959504    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959516    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959522    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959530    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959536    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959545    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959553    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959564    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959572    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959660    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959671    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959682    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="905a5b0d-4cab-478c-9aeb-eb3d3b0ac59b" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959692    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f787c39f-54f1-4ea6-8f72-09cc8602d4e1" containerName="istio-proxy"
Jul 27 20:00:13.959746 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.959700    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e837ca8c-4865-47b6-9b7e-0fc746d3b7f0" containerName="istio-proxy"
Jul 27 20:00:13.969468 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.969440    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:13.972042 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.972013    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-61128fd0-openshift-default-dockercfg-n4ml6\""
Jul 27 20:00:13.976292 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:13.976229    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"]
Jul 27 20:00:14.046429 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-token\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046638 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b445db1f-c398-4d23-bc3b-3a1d06537969-istiod-ca-cert\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046638 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046536    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-credential-socket\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046638 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-socket\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046801 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-podinfo\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046801 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-envoy\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046801 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-certs\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046960 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-data\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.046960 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.046937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22p94\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-kube-api-access-22p94\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.147550 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.147515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b445db1f-c398-4d23-bc3b-3a1d06537969-istiod-ca-cert\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.147750 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.147650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-credential-socket\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.147750 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.147685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-socket\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.147750 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.147744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-podinfo\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.147970 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.147785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-envoy\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.147970 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.147813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-certs\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148062 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.147994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-data\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148126 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.148080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22p94\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-kube-api-access-22p94\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148126 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.148085    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-credential-socket\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148240 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.148161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-token\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.148252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-certs\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148389 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.148364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-socket\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148495 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.148411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b445db1f-c398-4d23-bc3b-3a1d06537969-istiod-ca-cert\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.148570 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.148549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-data\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.150375 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.150346    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-envoy\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.150484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.150468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-podinfo\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.158153 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.158123    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22p94\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-kube-api-access-22p94\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.158284 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.158129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-token\") pod \"e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") " pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.285282 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.285184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:14.436287 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.436264    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"]
Jul 27 20:00:14.438765 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:00:14.438720    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb445db1f_c398_4d23_bc3b_3a1d06537969.slice/crio-186c46cafc083d169a0ef61df3f443b17a8aeed25ce928777effe91cb872d9d7 WatchSource:0}: Error finding container 186c46cafc083d169a0ef61df3f443b17a8aeed25ce928777effe91cb872d9d7: Status 404 returned error can't find the container with id 186c46cafc083d169a0ef61df3f443b17a8aeed25ce928777effe91cb872d9d7
Jul 27 20:00:14.441417 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.441384    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:00:14.441539 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.441460    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:00:14.441539 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.441507    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:00:14.880642 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.880602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" event={"ID":"b445db1f-c398-4d23-bc3b-3a1d06537969","Type":"ContainerStarted","Data":"f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3"}
Jul 27 20:00:14.880817 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.880660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" event={"ID":"b445db1f-c398-4d23-bc3b-3a1d06537969","Type":"ContainerStarted","Data":"186c46cafc083d169a0ef61df3f443b17a8aeed25ce928777effe91cb872d9d7"}
Jul 27 20:00:14.953368 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:14.953316    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podStartSLOduration=1.953298512 podStartE2EDuration="1.953298512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:00:14.945159043 +0000 UTC m=+2074.640715137" watchObservedRunningTime="2026-07-27 20:00:14.953298512 +0000 UTC m=+2074.648854651"
Jul 27 20:00:15.285862 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:15.285817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:15.290189 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:15.290167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:15.890871 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:15.888405    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:15.892123 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:15.892098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:23.065427 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:23.065391    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:00:31.435820 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.434370    2559 patch_prober.go:28] interesting pod/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": read tcp 10.132.0.2:46016->10.132.0.80:15021: read: connection reset by peer" start-of-body=
Jul 27 20:00:31.435820 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.434434    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": read tcp 10.132.0.2:46016->10.132.0.80:15021: read: connection reset by peer"
Jul 27 20:00:31.970178 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.970142    2559 generic.go:356] "Generic (PLEG): container finished" podID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerID="f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3" exitCode=0
Jul 27 20:00:31.970357 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.970213    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" event={"ID":"b445db1f-c398-4d23-bc3b-3a1d06537969","Type":"ContainerDied","Data":"f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3"}
Jul 27 20:00:31.970617 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.970602    2559 scope.go:117] "RemoveContainer" containerID="f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3"
Jul 27 20:00:31.971584 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.971553    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:00:31.971669 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.971624    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:00:31.971669 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:31.971664    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:00:32.976636 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:32.976596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" event={"ID":"b445db1f-c398-4d23-bc3b-3a1d06537969","Type":"ContainerStarted","Data":"c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55"}
Jul 27 20:00:33.286286 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:33.286194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:33.286477 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:33.286457    2559 patch_prober.go:28] interesting pod/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 20:00:33.286535 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:33.286515    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 20:00:34.285884 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:34.285828    2559 patch_prober.go:28] interesting pod/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 20:00:34.286363 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:34.285900    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 20:00:35.286018 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:35.285981    2559 patch_prober.go:28] interesting pod/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 20:00:35.286419 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:35.286042    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 20:00:36.285523 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:36.285486    2559 patch_prober.go:28] interesting pod/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 20:00:36.285704 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:36.285554    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 20:00:37.289386 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:37.289354    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:37.289769 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:37.289604    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:37.290207 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:37.290188    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:40.953605 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:40.953575    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:00:40.956948 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:40.956927    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:00:40.958304 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:40.958286    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:00:40.961432 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:40.961412    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:00:41.460216 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:41.460181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:00:50.306552 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:50.306509    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"]
Jul 27 20:00:50.307127 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:50.306789    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy" containerID="cri-o://c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55" gracePeriod=30
Jul 27 20:00:52.292468 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:52.292425    2559 patch_prober.go:28] interesting pod/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 20:00:52.292868 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:52.292485    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:00:55.566947 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.566922    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:55.631381 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631298    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22p94\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-kube-api-access-22p94\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631381 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631335    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-credential-socket\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631381 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-certs\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631391    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-envoy\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631433    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-podinfo\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631453    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b445db1f-c398-4d23-bc3b-3a1d06537969-istiod-ca-cert\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631471    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-data\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631507    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-token\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.631674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631530    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-socket\") pod \"b445db1f-c398-4d23-bc3b-3a1d06537969\" (UID: \"b445db1f-c398-4d23-bc3b-3a1d06537969\") "
Jul 27 20:00:55.632030 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631714    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:55.632030 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631813    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b445db1f-c398-4d23-bc3b-3a1d06537969-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:00:55.632030 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.631831    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.632190 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.632039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:55.632292 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.632269    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:55.632371 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.632346    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-data" (OuterVolumeSpecName: "istio-data") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:55.634067 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.634042    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:00:55.634067 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.634049    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-token" (OuterVolumeSpecName: "istio-token") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:00:55.634198 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.634092    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-kube-api-access-22p94" (OuterVolumeSpecName: "kube-api-access-22p94") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "kube-api-access-22p94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:00:55.634198 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.634103    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b445db1f-c398-4d23-bc3b-3a1d06537969" (UID: "b445db1f-c398-4d23-bc3b-3a1d06537969"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:00:55.733213 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733173    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22p94\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-kube-api-access-22p94\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.733213 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733216    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.733441 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733228    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.733441 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733240    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.733441 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733253    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b445db1f-c398-4d23-bc3b-3a1d06537969-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.733441 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733263    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.733441 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733273    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b445db1f-c398-4d23-bc3b-3a1d06537969-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:55.733441 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:55.733282    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b445db1f-c398-4d23-bc3b-3a1d06537969-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:00:56.087942 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.087902    2559 generic.go:356] "Generic (PLEG): container finished" podID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerID="c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55" exitCode=0
Jul 27 20:00:56.088113 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.087953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" event={"ID":"b445db1f-c398-4d23-bc3b-3a1d06537969","Type":"ContainerDied","Data":"c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55"}
Jul 27 20:00:56.088113 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.087997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj" event={"ID":"b445db1f-c398-4d23-bc3b-3a1d06537969","Type":"ContainerDied","Data":"186c46cafc083d169a0ef61df3f443b17a8aeed25ce928777effe91cb872d9d7"}
Jul 27 20:00:56.088113 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.088020    2559 scope.go:117] "RemoveContainer" containerID="c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55"
Jul 27 20:00:56.088113 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.087959    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"
Jul 27 20:00:56.099362 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.099305    2559 scope.go:117] "RemoveContainer" containerID="f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3"
Jul 27 20:00:56.109247 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.109223    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"]
Jul 27 20:00:56.109315 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.109253    2559 scope.go:117] "RemoveContainer" containerID="c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55"
Jul 27 20:00:56.109564 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:00:56.109544    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55\": container with ID starting with c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55 not found: ID does not exist" containerID="c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55"
Jul 27 20:00:56.109623 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.109571    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55"} err="failed to get container status \"c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55\": rpc error: code = NotFound desc = could not find container \"c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55\": container with ID starting with c727cce7dd1657a77c51a8378d8165feb62125f10fb2c62447b3766749591b55 not found: ID does not exist"
Jul 27 20:00:56.109623 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.109588    2559 scope.go:117] "RemoveContainer" containerID="f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3"
Jul 27 20:00:56.109831 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:00:56.109812    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3\": container with ID starting with f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3 not found: ID does not exist" containerID="f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3"
Jul 27 20:00:56.109951 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.109838    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3"} err="failed to get container status \"f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3\": rpc error: code = NotFound desc = could not find container \"f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3\": container with ID starting with f43826341c1cdc7964dd2b19bdf07b31419f588278dc58060b39c8df942c2bd3 not found: ID does not exist"
Jul 27 20:00:56.112429 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.112409    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-61128fd0-openshift-default-6f5f986f8d-vcbjj"]
Jul 27 20:00:56.941968 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:00:56.941934    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" path="/var/lib/kubelet/pods/b445db1f-c398-4d23-bc3b-3a1d06537969/volumes"
Jul 27 20:01:09.616635 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.616602    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"]
Jul 27 20:01:09.617468 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.617440    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy"
Jul 27 20:01:09.617618 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.617499    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy"
Jul 27 20:01:09.617618 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.617530    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy"
Jul 27 20:01:09.617618 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.617539    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy"
Jul 27 20:01:09.617783 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.617643    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy"
Jul 27 20:01:09.617783 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.617657    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b445db1f-c398-4d23-bc3b-3a1d06537969" containerName="istio-proxy"
Jul 27 20:01:09.621443 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.621418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.623584 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.623561    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5fa9bc6b-openshift-default-dockercfg-m5zl8\""
Jul 27 20:01:09.630024 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.630003    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"]
Jul 27 20:01:09.763094 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-data\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-certs\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-podinfo\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-envoy\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp5vk\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-kube-api-access-wp5vk\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-socket\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-token\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763565 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-credential-socket\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.763565 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.763369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istiod-ca-cert\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864314 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-credential-socket\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istiod-ca-cert\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-data\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864415    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-certs\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-podinfo\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-envoy\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864763 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp5vk\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-kube-api-access-wp5vk\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864763 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-socket\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864763 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-token\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864763 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864727    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-credential-socket\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864993 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-data\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.864993 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.864883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-certs\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.865059 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.865043    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-socket\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.865121 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.865103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istiod-ca-cert\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.867204 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.867149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-podinfo\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.867357 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.867340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-envoy\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.872294 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.872269    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-token\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.872384 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.872359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp5vk\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-kube-api-access-wp5vk\") pod \"e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") " pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:09.932208 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:09.932168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:10.069421 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.069389    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"]
Jul 27 20:01:10.072512 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:01:10.072481    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0bd6dd_58d1_4b54_86ec_db68065744ad.slice/crio-dcc7d39880082af1eafbcdf4bcf906b5958031c33a6821aae93f031ed043ff57 WatchSource:0}: Error finding container dcc7d39880082af1eafbcdf4bcf906b5958031c33a6821aae93f031ed043ff57: Status 404 returned error can't find the container with id dcc7d39880082af1eafbcdf4bcf906b5958031c33a6821aae93f031ed043ff57
Jul 27 20:01:10.074775 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.074739    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:01:10.074890 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.074818    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:01:10.074890 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.074864    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:01:10.162035 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.161954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" event={"ID":"9a0bd6dd-58d1-4b54-86ec-db68065744ad","Type":"ContainerStarted","Data":"f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee"}
Jul 27 20:01:10.162035 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.162026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" event={"ID":"9a0bd6dd-58d1-4b54-86ec-db68065744ad","Type":"ContainerStarted","Data":"dcc7d39880082af1eafbcdf4bcf906b5958031c33a6821aae93f031ed043ff57"}
Jul 27 20:01:10.181256 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.181200    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" podStartSLOduration=1.181184516 podStartE2EDuration="1.181184516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:01:10.179560834 +0000 UTC m=+2129.875116929" watchObservedRunningTime="2026-07-27 20:01:10.181184516 +0000 UTC m=+2129.876740609"
Jul 27 20:01:10.932877 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:10.932809    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:11.937233 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:11.937203    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:12.171539 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:12.171499    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:12.172528 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:12.172506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:14.465974 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:14.465930    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:01:23.234971 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:23.234935    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerID="f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee" exitCode=0
Jul 27 20:01:23.235411 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:23.235008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" event={"ID":"9a0bd6dd-58d1-4b54-86ec-db68065744ad","Type":"ContainerDied","Data":"f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee"}
Jul 27 20:01:23.235459 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:23.235413    2559 scope.go:117] "RemoveContainer" containerID="f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee"
Jul 27 20:01:23.236421 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:23.236389    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:01:23.236519 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:23.236472    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:01:23.236581 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:23.236520    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:01:24.241916 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:24.241881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" event={"ID":"9a0bd6dd-58d1-4b54-86ec-db68065744ad","Type":"ContainerStarted","Data":"179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf"}
Jul 27 20:01:24.933246 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:24.933213    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:24.934461 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:24.934433    2559 patch_prober.go:28] interesting pod/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 20:01:24.934593 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:24.934482    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 20:01:25.933244 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:25.933210    2559 patch_prober.go:28] interesting pod/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 20:01:25.933692 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:25.933669    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 20:01:26.932859 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:26.932822    2559 patch_prober.go:28] interesting pod/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 20:01:26.933058 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:26.932916    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 20:01:27.171425 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:27.171390    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:27.932718 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:27.932681    2559 patch_prober.go:28] interesting pod/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 27 20:01:27.932910 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:27.932743    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 27 20:01:28.941945 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:28.941920    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:28.943043 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:28.943025    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:01:38.555118 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:01:38.555037    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:02:01.868606 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:02:01.868563    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:02:20.759703 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:02:20.759664    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:02:29.064979 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:02:29.064944    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:03:18.212679 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:18.212644    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"]
Jul 27 20:03:18.213160 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:18.212916    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy" containerID="cri-o://179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf" gracePeriod=30
Jul 27 20:03:22.232265 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:22.232225    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:03:23.473684 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.473655    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:03:23.588446 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588360    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp5vk\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-kube-api-access-wp5vk\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.588446 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588434    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-podinfo\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.588665 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588454    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-credential-socket\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.588665 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-data\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.588665 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588502    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-envoy\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.588665 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588585    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istiod-ca-cert\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.588665 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588619    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-token\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.588665 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588655    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-certs\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.589021 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588680    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-socket\") pod \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\" (UID: \"9a0bd6dd-58d1-4b54-86ec-db68065744ad\") "
Jul 27 20:03:23.589021 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.588831    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:03:23.589021 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.589019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:03:23.589187 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.589081    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.589187 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.589101    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.589187 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.589105    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:03:23.589351 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.589335    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:03:23.589413 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.589361    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:03:23.590720 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.590696    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:03:23.590720 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.590703    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:03:23.591034 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.591016    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-kube-api-access-wp5vk" (OuterVolumeSpecName: "kube-api-access-wp5vk") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "kube-api-access-wp5vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:03:23.591144 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.591126    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a0bd6dd-58d1-4b54-86ec-db68065744ad" (UID: "9a0bd6dd-58d1-4b54-86ec-db68065744ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:03:23.690507 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.690475    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.690507 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.690503    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.690507 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.690515    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.690750 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.690526    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp5vk\" (UniqueName: \"kubernetes.io/projected/9a0bd6dd-58d1-4b54-86ec-db68065744ad-kube-api-access-wp5vk\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.690750 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.690536    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.690750 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.690544    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.690750 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.690552    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a0bd6dd-58d1-4b54-86ec-db68065744ad-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:03:23.842208 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.842115    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerID="179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf" exitCode=0
Jul 27 20:03:23.842208 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.842156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" event={"ID":"9a0bd6dd-58d1-4b54-86ec-db68065744ad","Type":"ContainerDied","Data":"179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf"}
Jul 27 20:03:23.842208 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.842175    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"
Jul 27 20:03:23.842208 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.842202    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6" event={"ID":"9a0bd6dd-58d1-4b54-86ec-db68065744ad","Type":"ContainerDied","Data":"dcc7d39880082af1eafbcdf4bcf906b5958031c33a6821aae93f031ed043ff57"}
Jul 27 20:03:23.842545 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.842224    2559 scope.go:117] "RemoveContainer" containerID="179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf"
Jul 27 20:03:23.851696 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.851673    2559 scope.go:117] "RemoveContainer" containerID="f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee"
Jul 27 20:03:23.862273 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.862251    2559 scope.go:117] "RemoveContainer" containerID="179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf"
Jul 27 20:03:23.862570 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:03:23.862544    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf\": container with ID starting with 179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf not found: ID does not exist" containerID="179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf"
Jul 27 20:03:23.862700 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.862581    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf"} err="failed to get container status \"179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf\": rpc error: code = NotFound desc = could not find container \"179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf\": container with ID starting with 179d3f6033485f95898e492753e5b5118551ae3c9ecb17f4346b6ad886372ebf not found: ID does not exist"
Jul 27 20:03:23.862700 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.862619    2559 scope.go:117] "RemoveContainer" containerID="f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee"
Jul 27 20:03:23.862967 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:03:23.862946    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee\": container with ID starting with f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee not found: ID does not exist" containerID="f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee"
Jul 27 20:03:23.863026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.862974    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee"} err="failed to get container status \"f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee\": rpc error: code = NotFound desc = could not find container \"f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee\": container with ID starting with f4b0e861c30d7ecdc4213286a19714bfd223c259f420e7ec6e79594ad85634ee not found: ID does not exist"
Jul 27 20:03:23.864432 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.864413    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"]
Jul 27 20:03:23.868902 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:23.868879    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5fa9bc6b-openshift-default-7c6bf4f44d-kd2r6"]
Jul 27 20:03:24.942111 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:24.942080    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" path="/var/lib/kubelet/pods/9a0bd6dd-58d1-4b54-86ec-db68065744ad/volumes"
Jul 27 20:03:33.756743 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:03:33.756703    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:04:13.816799 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.816758    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"]
Jul 27 20:04:13.817445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.817180    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy"
Jul 27 20:04:13.817445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.817193    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy"
Jul 27 20:04:13.817445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.817207    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy"
Jul 27 20:04:13.817445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.817213    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy"
Jul 27 20:04:13.817445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.817274    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy"
Jul 27 20:04:13.817445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.817283    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a0bd6dd-58d1-4b54-86ec-db68065744ad" containerName="istio-proxy"
Jul 27 20:04:13.820024 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.819999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.822340 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.822312    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-20b70e-openshift-default-dockercfg-w22x8\""
Jul 27 20:04:13.832023 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.832000    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"]
Jul 27 20:04:13.969646 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-socket\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.969810 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-certs\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.969810 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969743    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-credential-socket\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.969810 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-envoy\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.969810 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-data\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.969971 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-token\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.969971 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9gr\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-kube-api-access-7w9gr\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.969971 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istiod-ca-cert\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:13.970069 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:13.969983    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-podinfo\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071091 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.070991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-credential-socket\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071091 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-envoy\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071290 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-data\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071290 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-token\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071290 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9gr\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-kube-api-access-7w9gr\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071290 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istiod-ca-cert\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071475 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-podinfo\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071475 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-socket\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071475 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071394    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-credential-socket\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071475 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-certs\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071712 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-data\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.071780 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-certs\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.072044 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.071992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-socket\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.072385 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.072362    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istiod-ca-cert\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.074468 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.074443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-envoy\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.074760 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.074741    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-podinfo\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.078715 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.078690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-token\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.078800 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.078785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9gr\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-kube-api-access-7w9gr\") pod \"e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") " pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.133464 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.133431    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:14.273690 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.273663    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"]
Jul 27 20:04:14.275323 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:04:14.275296    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc912ee4f_1a27_45f3_aff6_d9d7a42517dc.slice/crio-233a176c2e6f8d397c69da15d66eb90d937cf708242a435f567dcab8a5eb5ed2 WatchSource:0}: Error finding container 233a176c2e6f8d397c69da15d66eb90d937cf708242a435f567dcab8a5eb5ed2: Status 404 returned error can't find the container with id 233a176c2e6f8d397c69da15d66eb90d937cf708242a435f567dcab8a5eb5ed2
Jul 27 20:04:14.277397 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.277366    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:14.277462 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.277449    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:14.277505 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:14.277484    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:15.120299 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:15.120266    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" event={"ID":"c912ee4f-1a27-45f3-aff6-d9d7a42517dc","Type":"ContainerStarted","Data":"fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2"}
Jul 27 20:04:15.120712 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:15.120316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" event={"ID":"c912ee4f-1a27-45f3-aff6-d9d7a42517dc","Type":"ContainerStarted","Data":"233a176c2e6f8d397c69da15d66eb90d937cf708242a435f567dcab8a5eb5ed2"}
Jul 27 20:04:15.134122 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:15.134098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:15.138934 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:15.138914    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:15.142574 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:15.142535    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" podStartSLOduration=2.142521901 podStartE2EDuration="2.142521901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:15.139623404 +0000 UTC m=+2314.835179498" watchObservedRunningTime="2026-07-27 20:04:15.142521901 +0000 UTC m=+2314.838077995"
Jul 27 20:04:16.125716 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:16.125683    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:16.126643 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:16.126619    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:21.959280 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:21.959246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:04:22.105293 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.105253    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"]
Jul 27 20:04:22.108604 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.108579    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.111009 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.110984    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-461c95-openshift-default-dockercfg-llglv\""
Jul 27 20:04:22.118788 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.118766    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"]
Jul 27 20:04:22.251895 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.251771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-credential-socket\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.251895 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.251820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-data\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.251895 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.251845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-istio-token\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.252123 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.251984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-certs\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.252123 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.252018    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-envoy\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.252123 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.252062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0359e66-105f-4765-a4d5-b85219d402d9-istio-podinfo\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.252123 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.252092    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-socket\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.252255 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.252143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25qgb\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-kube-api-access-25qgb\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.252255 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.252164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0359e66-105f-4765-a4d5-b85219d402d9-istiod-ca-cert\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353121 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0359e66-105f-4765-a4d5-b85219d402d9-istio-podinfo\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-socket\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25qgb\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-kube-api-access-25qgb\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353288    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0359e66-105f-4765-a4d5-b85219d402d9-istiod-ca-cert\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353469 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-credential-socket\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353469 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-data\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353469 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-istio-token\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353469 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-certs\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353469 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-envoy\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353735 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353490    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-socket\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.353918 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353885    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-data\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.354000 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.353927    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-certs\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.354047 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.354017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-credential-socket\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.354047 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.354024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0359e66-105f-4765-a4d5-b85219d402d9-istiod-ca-cert\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.355608 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.355588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-envoy\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.355716 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.355662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0359e66-105f-4765-a4d5-b85219d402d9-istio-podinfo\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.360844 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.360820    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-istio-token\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.360956 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.360847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25qgb\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-kube-api-access-25qgb\") pod \"e2e-inf-b-461c95-openshift-default-7748786776-vdhzh\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") " pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.421310 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.421276    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:22.565044 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.565015    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"]
Jul 27 20:04:22.567278 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:04:22.567252    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0359e66_105f_4765_a4d5_b85219d402d9.slice/crio-cf912724f7a956aee345728b163885b761d348e8ece255b1f46ebdbc53f57291 WatchSource:0}: Error finding container cf912724f7a956aee345728b163885b761d348e8ece255b1f46ebdbc53f57291: Status 404 returned error can't find the container with id cf912724f7a956aee345728b163885b761d348e8ece255b1f46ebdbc53f57291
Jul 27 20:04:22.570037 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.569995    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:22.570142 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.570086    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:22.570142 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:22.570121    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:23.158885 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:23.158833    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" event={"ID":"b0359e66-105f-4765-a4d5-b85219d402d9","Type":"ContainerStarted","Data":"3507c90520dd66cd4fda0560bae38bb45969ec599997099ff790233b3ababe17"}
Jul 27 20:04:23.159266 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:23.158911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" event={"ID":"b0359e66-105f-4765-a4d5-b85219d402d9","Type":"ContainerStarted","Data":"cf912724f7a956aee345728b163885b761d348e8ece255b1f46ebdbc53f57291"}
Jul 27 20:04:23.178616 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:23.178568    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podStartSLOduration=1.1785533 podStartE2EDuration="1.1785533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:23.178076665 +0000 UTC m=+2322.873632759" watchObservedRunningTime="2026-07-27 20:04:23.1785533 +0000 UTC m=+2322.874109377"
Jul 27 20:04:23.422346 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:23.422249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:23.430900 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:23.430868    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:24.163637 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:24.163600    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:24.164633 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:24.164615    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:30.196615 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:30.196581    2559 generic.go:356] "Generic (PLEG): container finished" podID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerID="fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2" exitCode=0
Jul 27 20:04:30.197167 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:30.196651    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" event={"ID":"c912ee4f-1a27-45f3-aff6-d9d7a42517dc","Type":"ContainerDied","Data":"fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2"}
Jul 27 20:04:30.197167 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:30.197111    2559 scope.go:117] "RemoveContainer" containerID="fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2"
Jul 27 20:04:30.198188 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:30.198155    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:30.198290 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:30.198232    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:30.198290 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:30.198262    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:31.125982 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:31.125938    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:31.204063 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:31.204034    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" event={"ID":"c912ee4f-1a27-45f3-aff6-d9d7a42517dc","Type":"ContainerStarted","Data":"c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f"}
Jul 27 20:04:32.134919 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:32.134806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:32.136086 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:32.136053    2559 patch_prober.go:28] interesting pod/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 20:04:32.136320 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:32.136291    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 20:04:33.134016 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:33.133973    2559 patch_prober.go:28] interesting pod/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 20:04:33.134627 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:33.134593    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 20:04:34.134735 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:34.134693    2559 patch_prober.go:28] interesting pod/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 20:04:34.135385 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:34.135346    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 20:04:35.134846 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:35.134802    2559 patch_prober.go:28] interesting pod/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 20:04:35.135381 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:35.134892    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 20:04:36.138286 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:36.138250    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:36.138697 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:36.138674    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:36.139442 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:36.139424    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:04:38.164888 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:38.164840    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:04:38.251425 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:38.251393    2559 generic.go:356] "Generic (PLEG): container finished" podID="b0359e66-105f-4765-a4d5-b85219d402d9" containerID="3507c90520dd66cd4fda0560bae38bb45969ec599997099ff790233b3ababe17" exitCode=0
Jul 27 20:04:38.251592 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:38.251466    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" event={"ID":"b0359e66-105f-4765-a4d5-b85219d402d9","Type":"ContainerDied","Data":"3507c90520dd66cd4fda0560bae38bb45969ec599997099ff790233b3ababe17"}
Jul 27 20:04:38.251882 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:38.251869    2559 scope.go:117] "RemoveContainer" containerID="3507c90520dd66cd4fda0560bae38bb45969ec599997099ff790233b3ababe17"
Jul 27 20:04:38.253018 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:38.252990    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:38.253098 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:38.253063    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:38.253139 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:38.253097    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:04:39.163949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:39.163916    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:39.258486 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:39.258452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" event={"ID":"b0359e66-105f-4765-a4d5-b85219d402d9","Type":"ContainerStarted","Data":"74d037f2e8472060335b7c89f5d04541a9e098fcc1beb8e93c29beb85501b374"}
Jul 27 20:04:39.421795 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:39.421706    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:39.422887 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:39.422839    2559 patch_prober.go:28] interesting pod/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 20:04:39.423015 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:39.422911    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 20:04:40.421980 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:40.421922    2559 patch_prober.go:28] interesting pod/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 20:04:40.422496 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:40.422013    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 20:04:41.425601 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:41.425556    2559 patch_prober.go:28] interesting pod/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 20:04:41.426122 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:41.425624    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 20:04:42.422670 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:42.422619    2559 patch_prober.go:28] interesting pod/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 20:04:42.422909 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:42.422712    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 20:04:43.422517 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:43.422478    2559 patch_prober.go:28] interesting pod/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 27 20:04:43.423169 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:43.423131    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 27 20:04:44.425578 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:44.425544    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:44.426070 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:44.425817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:44.426570 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:44.426549    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:04:54.162892 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:04:54.162843    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:05:09.585904 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.585868    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"]
Jul 27 20:05:09.589260 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.589237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.592418 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.592397    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-461c95\"/\"openshift-service-ca.crt\""
Jul 27 20:05:09.592551 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.592471    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-461c95\"/\"kube-root-ca.crt\""
Jul 27 20:05:09.592551 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.592491    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-461c95\"/\"test-model-461c95-kserve-self-signed-certs\""
Jul 27 20:05:09.592669 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.592649    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-461c95\"/\"default-dockercfg-8nn2w\""
Jul 27 20:05:09.598111 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.598084    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"]
Jul 27 20:05:09.611238 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.611191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-dshm\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.611238 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.611250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-model-cache\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.611528 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.611280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tpth\" (UniqueName: \"kubernetes.io/projected/f7a4d0fe-b167-46a8-9c82-d66c397815d9-kube-api-access-2tpth\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.611528 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.611337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tls-certs\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.611528 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.611369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tmp-dir\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.611528 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.611391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-home\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.712712 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.712669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-model-cache\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.712712 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.712716    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tpth\" (UniqueName: \"kubernetes.io/projected/f7a4d0fe-b167-46a8-9c82-d66c397815d9-kube-api-access-2tpth\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.713089 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.712750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tls-certs\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.713089 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.712780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tmp-dir\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.713089 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.712808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-home\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.713089 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.712967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-dshm\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.713314 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.713179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-model-cache\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.713314 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.713229    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tmp-dir\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.713314 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.713259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-home\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.715130 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.715100    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-dshm\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.715255 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.715236    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tls-certs\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.720143 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.720124    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tpth\" (UniqueName: \"kubernetes.io/projected/f7a4d0fe-b167-46a8-9c82-d66c397815d9-kube-api-access-2tpth\") pod \"test-model-461c95-kserve-6b67c9cbdf-5x5dz\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") " pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:09.901671 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:09.901572    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:10.039188 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:10.039163    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"]
Jul 27 20:05:10.041249 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:05:10.041224    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a4d0fe_b167_46a8_9c82_d66c397815d9.slice/crio-376738c0dcc7ae289354bf111ef01023e837370dbe6a7c543ab04c00c26da66b WatchSource:0}: Error finding container 376738c0dcc7ae289354bf111ef01023e837370dbe6a7c543ab04c00c26da66b: Status 404 returned error can't find the container with id 376738c0dcc7ae289354bf111ef01023e837370dbe6a7c543ab04c00c26da66b
Jul 27 20:05:10.421080 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:10.420989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz" event={"ID":"f7a4d0fe-b167-46a8-9c82-d66c397815d9","Type":"ContainerStarted","Data":"8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330"}
Jul 27 20:05:10.421080 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:10.421032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz" event={"ID":"f7a4d0fe-b167-46a8-9c82-d66c397815d9","Type":"ContainerStarted","Data":"376738c0dcc7ae289354bf111ef01023e837370dbe6a7c543ab04c00c26da66b"}
Jul 27 20:05:10.437779 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:10.437729    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz" podStartSLOduration=1.437713133 podStartE2EDuration="1.437713133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:10.436345468 +0000 UTC m=+2370.131901561" watchObservedRunningTime="2026-07-27 20:05:10.437713133 +0000 UTC m=+2370.133269257"
Jul 27 20:05:11.957636 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:11.957596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:05:19.901990 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:19.901940    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:19.902556 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:19.902004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:19.916608 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:19.916580    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:20.483178 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:20.483147    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:05:26.255618 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:26.255579    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:05:40.986729 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:40.986705    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:05:40.991828 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:40.991803    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:05:40.991977 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:40.991808    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:05:40.996790 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:05:40.996765    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:06:00.114592 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:00.114556    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"]
Jul 27 20:06:02.662587 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:02.662503    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:06:15.133559 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.133512    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz" podUID="f7a4d0fe-b167-46a8-9c82-d66c397815d9" containerName="main" containerID="cri-o://8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330" gracePeriod=45
Jul 27 20:06:15.393166 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.393106    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:06:15.461802 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.461768    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:06:15.564077 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tls-certs\") pod \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") "
Jul 27 20:06:15.564247 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564107    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-home\") pod \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") "
Jul 27 20:06:15.564247 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564214    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tmp-dir\") pod \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") "
Jul 27 20:06:15.564331 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tpth\" (UniqueName: \"kubernetes.io/projected/f7a4d0fe-b167-46a8-9c82-d66c397815d9-kube-api-access-2tpth\") pod \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") "
Jul 27 20:06:15.564383 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564330    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-dshm\") pod \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") "
Jul 27 20:06:15.564383 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564355    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-home" (OuterVolumeSpecName: "home") pod "f7a4d0fe-b167-46a8-9c82-d66c397815d9" (UID: "f7a4d0fe-b167-46a8-9c82-d66c397815d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:15.564383 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564376    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-model-cache\") pod \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\" (UID: \"f7a4d0fe-b167-46a8-9c82-d66c397815d9\") "
Jul 27 20:06:15.564523 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564502    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f7a4d0fe-b167-46a8-9c82-d66c397815d9" (UID: "f7a4d0fe-b167-46a8-9c82-d66c397815d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:15.564704 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "f7a4d0fe-b167-46a8-9c82-d66c397815d9" (UID: "f7a4d0fe-b167-46a8-9c82-d66c397815d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:15.564867 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564824    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tmp-dir\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:15.564994 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564877    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-model-cache\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:15.564994 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.564891    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-home\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:15.566509 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.566481    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f7a4d0fe-b167-46a8-9c82-d66c397815d9" (UID: "f7a4d0fe-b167-46a8-9c82-d66c397815d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:06:15.566629 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.566605    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a4d0fe-b167-46a8-9c82-d66c397815d9-kube-api-access-2tpth" (OuterVolumeSpecName: "kube-api-access-2tpth") pod "f7a4d0fe-b167-46a8-9c82-d66c397815d9" (UID: "f7a4d0fe-b167-46a8-9c82-d66c397815d9"). InnerVolumeSpecName "kube-api-access-2tpth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:15.566683 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.566605    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-dshm" (OuterVolumeSpecName: "dshm") pod "f7a4d0fe-b167-46a8-9c82-d66c397815d9" (UID: "f7a4d0fe-b167-46a8-9c82-d66c397815d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:15.665694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.665591    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7a4d0fe-b167-46a8-9c82-d66c397815d9-tls-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:15.665694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.665641    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tpth\" (UniqueName: \"kubernetes.io/projected/f7a4d0fe-b167-46a8-9c82-d66c397815d9-kube-api-access-2tpth\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:15.665694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.665652    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7a4d0fe-b167-46a8-9c82-d66c397815d9-dshm\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:15.754016 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.753978    2559 generic.go:356] "Generic (PLEG): container finished" podID="f7a4d0fe-b167-46a8-9c82-d66c397815d9" containerID="8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330" exitCode=0
Jul 27 20:06:15.754201 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.754022    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"
Jul 27 20:06:15.754201 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.754067    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz" event={"ID":"f7a4d0fe-b167-46a8-9c82-d66c397815d9","Type":"ContainerDied","Data":"8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330"}
Jul 27 20:06:15.754201 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.754110    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz" event={"ID":"f7a4d0fe-b167-46a8-9c82-d66c397815d9","Type":"ContainerDied","Data":"376738c0dcc7ae289354bf111ef01023e837370dbe6a7c543ab04c00c26da66b"}
Jul 27 20:06:15.754201 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.754128    2559 scope.go:117] "RemoveContainer" containerID="8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330"
Jul 27 20:06:15.763059 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.763044    2559 scope.go:117] "RemoveContainer" containerID="8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330"
Jul 27 20:06:15.763338 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:06:15.763320    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330\": container with ID starting with 8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330 not found: ID does not exist" containerID="8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330"
Jul 27 20:06:15.763388 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.763347    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330"} err="failed to get container status \"8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330\": rpc error: code = NotFound desc = could not find container \"8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330\": container with ID starting with 8ca7ad0e1eae34a8e8d825feaeaeb901cb412e783b791e6943b1e6aa7e87a330 not found: ID does not exist"
Jul 27 20:06:15.774115 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.774093    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"]
Jul 27 20:06:15.775818 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:15.775801    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-461c95/test-model-461c95-kserve-6b67c9cbdf-5x5dz"]
Jul 27 20:06:16.942532 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:16.942495    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a4d0fe-b167-46a8-9c82-d66c397815d9" path="/var/lib/kubelet/pods/f7a4d0fe-b167-46a8-9c82-d66c397815d9/volumes"
Jul 27 20:06:21.761036 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:21.760999    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"]
Jul 27 20:06:21.761526 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:21.761219    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy" containerID="cri-o://c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f" gracePeriod=30
Jul 27 20:06:27.014636 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.014608    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:06:27.060149 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060055    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-socket\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060149 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060121    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-data\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060149 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060146    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w9gr\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-kube-api-access-7w9gr\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060420 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060203    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-token\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060420 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060237    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-certs\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060420 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060390    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-podinfo\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060635 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060437    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-envoy\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060635 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060441    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:27.060635 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060483    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istiod-ca-cert\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060635 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060550    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-credential-socket\") pod \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\" (UID: \"c912ee4f-1a27-45f3-aff6-d9d7a42517dc\") "
Jul 27 20:06:27.060635 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060579    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:27.060927 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060870    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:27.060927 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060918    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:27.062414 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060924    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.062414 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.060960    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.062414 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.061666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:27.062831 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.062808    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:06:27.062951 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.062929    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-kube-api-access-7w9gr" (OuterVolumeSpecName: "kube-api-access-7w9gr") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "kube-api-access-7w9gr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:27.063574 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.063553    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:27.063730 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.063704    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c912ee4f-1a27-45f3-aff6-d9d7a42517dc" (UID: "c912ee4f-1a27-45f3-aff6-d9d7a42517dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:27.161899 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.161838    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.161899 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.161896    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w9gr\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-kube-api-access-7w9gr\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.161899 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.161906    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.162136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.161914    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.162136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.161922    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.162136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.161930    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.162136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.161938    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c912ee4f-1a27-45f3-aff6-d9d7a42517dc-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:27.815643 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.815612    2559 generic.go:356] "Generic (PLEG): container finished" podID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerID="c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f" exitCode=0
Jul 27 20:06:27.815821 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.815664    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"
Jul 27 20:06:27.815821 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.815674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" event={"ID":"c912ee4f-1a27-45f3-aff6-d9d7a42517dc","Type":"ContainerDied","Data":"c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f"}
Jul 27 20:06:27.815821 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.815718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc" event={"ID":"c912ee4f-1a27-45f3-aff6-d9d7a42517dc","Type":"ContainerDied","Data":"233a176c2e6f8d397c69da15d66eb90d937cf708242a435f567dcab8a5eb5ed2"}
Jul 27 20:06:27.815821 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.815740    2559 scope.go:117] "RemoveContainer" containerID="c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f"
Jul 27 20:06:27.825376 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.825358    2559 scope.go:117] "RemoveContainer" containerID="fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2"
Jul 27 20:06:27.833229 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.833209    2559 scope.go:117] "RemoveContainer" containerID="c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f"
Jul 27 20:06:27.833480 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:06:27.833462    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f\": container with ID starting with c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f not found: ID does not exist" containerID="c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f"
Jul 27 20:06:27.833535 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.833487    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f"} err="failed to get container status \"c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f\": rpc error: code = NotFound desc = could not find container \"c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f\": container with ID starting with c9a5be8f15e7630b6c6669a15c9bd3e4b054d9955a9b939d823996a008d2100f not found: ID does not exist"
Jul 27 20:06:27.833535 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.833508    2559 scope.go:117] "RemoveContainer" containerID="fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2"
Jul 27 20:06:27.833732 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:06:27.833716    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2\": container with ID starting with fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2 not found: ID does not exist" containerID="fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2"
Jul 27 20:06:27.833780 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.833738    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2"} err="failed to get container status \"fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2\": rpc error: code = NotFound desc = could not find container \"fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2\": container with ID starting with fd7ac86a3a179f11428da847ae7c364164f44744fe3a6545ebe0d40ac94c82a2 not found: ID does not exist"
Jul 27 20:06:27.836948 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.836929    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"]
Jul 27 20:06:27.840109 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:27.840085    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-20b70e-openshift-default-76dc4d6cd6-5fmxc"]
Jul 27 20:06:28.941814 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:28.941778    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" path="/var/lib/kubelet/pods/c912ee4f-1a27-45f3-aff6-d9d7a42517dc/volumes"
Jul 27 20:06:35.655823 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:35.655784    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:06:43.721487 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:43.721454    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"]
Jul 27 20:06:43.721952 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:43.721683    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy" containerID="cri-o://74d037f2e8472060335b7c89f5d04541a9e098fcc1beb8e93c29beb85501b374" gracePeriod=30
Jul 27 20:06:44.428237 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.428199    2559 patch_prober.go:28] interesting pod/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 20:06:44.428433 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.428275    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:06:44.568614 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.568578    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"]
Jul 27 20:06:44.569203 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.569181    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a4d0fe-b167-46a8-9c82-d66c397815d9" containerName="main"
Jul 27 20:06:44.569203 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.569202    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a4d0fe-b167-46a8-9c82-d66c397815d9" containerName="main"
Jul 27 20:06:44.569370 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.569219    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy"
Jul 27 20:06:44.569370 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.569225    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy"
Jul 27 20:06:44.569370 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.569316    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy"
Jul 27 20:06:44.569370 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.569326    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy"
Jul 27 20:06:44.569370 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.569335    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a4d0fe-b167-46a8-9c82-d66c397815d9" containerName="main"
Jul 27 20:06:44.573091 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.573072    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.575353 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.575334    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-110a90-openshift-default-dockercfg-fc2x6\""
Jul 27 20:06:44.581338 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.581306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"]
Jul 27 20:06:44.629235 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629203    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-envoy\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629435 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cf445d-75ce-44b2-9497-6aca581b3fa3-istiod-ca-cert\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629435 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8plwt\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-kube-api-access-8plwt\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629435 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629354    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-token\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629435 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-credential-socket\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629435 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-socket\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629641 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-data\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629641 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-certs\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.629641 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.629568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-podinfo\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730180 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-data\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730180 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-certs\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730180 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-podinfo\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730751 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-envoy\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730751 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cf445d-75ce-44b2-9497-6aca581b3fa3-istiod-ca-cert\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730751 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8plwt\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-kube-api-access-8plwt\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730751 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-token\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-data\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-credential-socket\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.730949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-socket\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.731071 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.730980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-certs\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.731220 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.731174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cf445d-75ce-44b2-9497-6aca581b3fa3-istiod-ca-cert\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.731339 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.731291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-socket\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.731411 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.731389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-credential-socket\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.733101 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.733079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-podinfo\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.733314 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.733297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-envoy\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.738233 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.738207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-token\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.738676 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.738647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8plwt\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-kube-api-access-8plwt\") pod \"e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") " pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:44.885839 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:44.885805    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:45.025612 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:45.025587    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"]
Jul 27 20:06:45.027460 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:06:45.027430    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cf445d_75ce_44b2_9497_6aca581b3fa3.slice/crio-96846159cde7c5d75f077c471b096c73a158b2c061d0ecf9cdc9c89bb6a53daf WatchSource:0}: Error finding container 96846159cde7c5d75f077c471b096c73a158b2c061d0ecf9cdc9c89bb6a53daf: Status 404 returned error can't find the container with id 96846159cde7c5d75f077c471b096c73a158b2c061d0ecf9cdc9c89bb6a53daf
Jul 27 20:06:45.029794 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:45.029748    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:06:45.029883 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:45.029846    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:06:45.029935 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:45.029919    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:06:45.914601 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:45.914559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" event={"ID":"58cf445d-75ce-44b2-9497-6aca581b3fa3","Type":"ContainerStarted","Data":"d1c9d755113067476ab0c2bcdade163e990efbe76f1a0068a4d9da619aa30def"}
Jul 27 20:06:45.915017 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:45.914627    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" event={"ID":"58cf445d-75ce-44b2-9497-6aca581b3fa3","Type":"ContainerStarted","Data":"96846159cde7c5d75f077c471b096c73a158b2c061d0ecf9cdc9c89bb6a53daf"}
Jul 27 20:06:45.934552 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:45.934506    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podStartSLOduration=1.934492214 podStartE2EDuration="1.934492214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:45.933999755 +0000 UTC m=+2465.629555852" watchObservedRunningTime="2026-07-27 20:06:45.934492214 +0000 UTC m=+2465.630048308"
Jul 27 20:06:46.886235 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:46.886199    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:46.891554 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:46.891527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:46.919751 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:46.919719    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:46.920812 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:46.920792    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:06:48.932127 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:48.932097    2559 generic.go:356] "Generic (PLEG): container finished" podID="b0359e66-105f-4765-a4d5-b85219d402d9" containerID="74d037f2e8472060335b7c89f5d04541a9e098fcc1beb8e93c29beb85501b374" exitCode=0
Jul 27 20:06:48.932540 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:48.932165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" event={"ID":"b0359e66-105f-4765-a4d5-b85219d402d9","Type":"ContainerDied","Data":"74d037f2e8472060335b7c89f5d04541a9e098fcc1beb8e93c29beb85501b374"}
Jul 27 20:06:48.932540 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:48.932235    2559 scope.go:117] "RemoveContainer" containerID="3507c90520dd66cd4fda0560bae38bb45969ec599997099ff790233b3ababe17"
Jul 27 20:06:48.977287 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:48.977264    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:06:49.073640 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073561    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0359e66-105f-4765-a4d5-b85219d402d9-istio-podinfo\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073640 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073629    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-credential-socket\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073649    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-socket\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073701    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25qgb\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-kube-api-access-25qgb\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-certs\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073750    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-envoy\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073774    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-data\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073798    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0359e66-105f-4765-a4d5-b85219d402d9-istiod-ca-cert\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.073949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.073873    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-istio-token\") pod \"b0359e66-105f-4765-a4d5-b85219d402d9\" (UID: \"b0359e66-105f-4765-a4d5-b85219d402d9\") "
Jul 27 20:06:49.074323 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074010    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:49.074323 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074176    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:49.074438 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074377    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:49.074438 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074416    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0359e66-105f-4765-a4d5-b85219d402d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:06:49.074890 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074831    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:49.075005 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074936    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.075005 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074955    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.075005 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074965    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.075005 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.074979    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0359e66-105f-4765-a4d5-b85219d402d9-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.076092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.076066    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-kube-api-access-25qgb" (OuterVolumeSpecName: "kube-api-access-25qgb") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "kube-api-access-25qgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:49.076339 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.076246    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:06:49.076339 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.076315    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0359e66-105f-4765-a4d5-b85219d402d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:06:49.076637 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.076621    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0359e66-105f-4765-a4d5-b85219d402d9" (UID: "b0359e66-105f-4765-a4d5-b85219d402d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:06:49.175886 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.175859    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0359e66-105f-4765-a4d5-b85219d402d9-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.175886 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.175884    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25qgb\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-kube-api-access-25qgb\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.175886 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.175894    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.176124 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.175902    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0359e66-105f-4765-a4d5-b85219d402d9-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.176124 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.175910    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0359e66-105f-4765-a4d5-b85219d402d9-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:06:49.939644 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.939614    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"
Jul 27 20:06:49.940105 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.939654    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh" event={"ID":"b0359e66-105f-4765-a4d5-b85219d402d9","Type":"ContainerDied","Data":"cf912724f7a956aee345728b163885b761d348e8ece255b1f46ebdbc53f57291"}
Jul 27 20:06:49.940105 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.939710    2559 scope.go:117] "RemoveContainer" containerID="74d037f2e8472060335b7c89f5d04541a9e098fcc1beb8e93c29beb85501b374"
Jul 27 20:06:49.960608 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.960582    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"]
Jul 27 20:06:49.965812 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:49.965789    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-461c95-openshift-default-7748786776-vdhzh"]
Jul 27 20:06:50.941763 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:50.941726    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" path="/var/lib/kubelet/pods/b0359e66-105f-4765-a4d5-b85219d402d9/volumes"
Jul 27 20:06:53.064530 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.064498    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"]
Jul 27 20:06:53.065097 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.065072    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy"
Jul 27 20:06:53.065097 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.065093    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c912ee4f-1a27-45f3-aff6-d9d7a42517dc" containerName="istio-proxy"
Jul 27 20:06:53.065097 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.065107    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy"
Jul 27 20:06:53.065097 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.065113    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy"
Jul 27 20:06:53.065424 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.065216    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy"
Jul 27 20:06:53.068703 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.068683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.070925 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.070902    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-16dc17-openshift-default-dockercfg-xqrq4\""
Jul 27 20:06:53.080862 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.080826    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"]
Jul 27 20:06:53.215184 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-podinfo\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215379 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-envoy\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215379 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-token\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215379 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215306    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e84633-25bc-44c5-9ad6-b93d6b209695-istiod-ca-cert\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215508 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-certs\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215508 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-credential-socket\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215508 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc4zm\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-kube-api-access-tc4zm\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215627 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-socket\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.215627 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.215560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-data\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.316666 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-credential-socket\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.316666 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc4zm\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-kube-api-access-tc4zm\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.316666 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-socket\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.316666 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-data\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317039 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-podinfo\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317039 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-envoy\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317039 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-token\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317039 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e84633-25bc-44c5-9ad6-b93d6b209695-istiod-ca-cert\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317039 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.316885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-certs\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317299 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.317070    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-credential-socket\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317299 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.317126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-data\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317299 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.317162    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-socket\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317461 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.317362    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-certs\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.317679 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.317653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e84633-25bc-44c5-9ad6-b93d6b209695-istiod-ca-cert\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.319330 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.319304    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-envoy\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.319488 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.319471    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-podinfo\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.323633 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.323615    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-token\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.323817 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.323801    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc4zm\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-kube-api-access-tc4zm\") pod \"e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") " pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.379051 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.379017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:53.521989 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.521956    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"]
Jul 27 20:06:53.525443 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:06:53.525406    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e84633_25bc_44c5_9ad6_b93d6b209695.slice/crio-ea5dd703362b09205e4360051a3b02670de52fc3ff706d523b03fab8443cfd8b WatchSource:0}: Error finding container ea5dd703362b09205e4360051a3b02670de52fc3ff706d523b03fab8443cfd8b: Status 404 returned error can't find the container with id ea5dd703362b09205e4360051a3b02670de52fc3ff706d523b03fab8443cfd8b
Jul 27 20:06:53.527636 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.527602    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:06:53.527741 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.527681    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:06:53.527741 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.527728    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:06:53.564072 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.564048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:06:53.961485 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.961452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" event={"ID":"b0e84633-25bc-44c5-9ad6-b93d6b209695","Type":"ContainerStarted","Data":"67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0"}
Jul 27 20:06:53.961650 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.961509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" event={"ID":"b0e84633-25bc-44c5-9ad6-b93d6b209695","Type":"ContainerStarted","Data":"ea5dd703362b09205e4360051a3b02670de52fc3ff706d523b03fab8443cfd8b"}
Jul 27 20:06:53.981635 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:53.981589    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" podStartSLOduration=0.981574765 podStartE2EDuration="981.574765ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:53.980661767 +0000 UTC m=+2473.676217861" watchObservedRunningTime="2026-07-27 20:06:53.981574765 +0000 UTC m=+2473.677130858"
Jul 27 20:06:54.379694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:54.379605    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:54.384474 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:54.384451    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:54.966216 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:54.966188    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:06:54.967165 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:06:54.967144    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:07:01.922036 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:01.921930    2559 patch_prober.go:28] interesting pod/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 27 20:07:01.922036 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:01.922003    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 27 20:07:02.001239 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:02.001139    2559 generic.go:356] "Generic (PLEG): container finished" podID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerID="d1c9d755113067476ab0c2bcdade163e990efbe76f1a0068a4d9da619aa30def" exitCode=0
Jul 27 20:07:02.001239 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:02.001208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" event={"ID":"58cf445d-75ce-44b2-9497-6aca581b3fa3","Type":"ContainerDied","Data":"d1c9d755113067476ab0c2bcdade163e990efbe76f1a0068a4d9da619aa30def"}
Jul 27 20:07:02.001671 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:02.001645    2559 scope.go:117] "RemoveContainer" containerID="d1c9d755113067476ab0c2bcdade163e990efbe76f1a0068a4d9da619aa30def"
Jul 27 20:07:02.002792 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:02.002762    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:07:02.002934 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:02.002827    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:07:02.002934 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:02.002870    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:07:03.010470 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:03.010432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" event={"ID":"58cf445d-75ce-44b2-9497-6aca581b3fa3","Type":"ContainerStarted","Data":"2bf43f68b2b321a08671f5b47ef0850902135b8af800c939180e7e35a268d9c7"}
Jul 27 20:07:03.886390 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:03.886349    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:07:03.886791 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:03.886769    2559 patch_prober.go:28] interesting pod/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 27 20:07:03.886876 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:03.886812    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 27 20:07:04.886328 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:04.886295    2559 patch_prober.go:28] interesting pod/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 27 20:07:04.886716 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:04.886347    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 27 20:07:05.887163 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:05.887128    2559 patch_prober.go:28] interesting pod/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 27 20:07:05.887533 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:05.887199    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 27 20:07:06.886945 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:06.886903    2559 patch_prober.go:28] interesting pod/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Jul 27 20:07:06.887191 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:06.886971    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Jul 27 20:07:07.890343 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:07.890310    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:07:07.890814 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:07.890715    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:07:07.891500 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:07.891480    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:07:09.055296 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:09.055258    2559 generic.go:356] "Generic (PLEG): container finished" podID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerID="67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0" exitCode=0
Jul 27 20:07:09.055794 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:09.055332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" event={"ID":"b0e84633-25bc-44c5-9ad6-b93d6b209695","Type":"ContainerDied","Data":"67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0"}
Jul 27 20:07:09.055946 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:09.055929    2559 scope.go:117] "RemoveContainer" containerID="67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0"
Jul 27 20:07:09.056912 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:09.056887    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:07:09.056977 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:09.056958    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:07:09.057017 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:09.056989    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:07:09.966455 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:09.966418    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:07:10.062685 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:10.062640    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" event={"ID":"b0e84633-25bc-44c5-9ad6-b93d6b209695","Type":"ContainerStarted","Data":"cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136"}
Jul 27 20:07:10.379311 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:10.379213    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:07:10.380552 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:10.380528    2559 patch_prober.go:28] interesting pod/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 20:07:10.380652 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:10.380580    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 20:07:10.662593 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:10.662503    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:07:11.380173 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:11.380124    2559 patch_prober.go:28] interesting pod/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 20:07:11.380566 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:11.380214    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 20:07:12.380006 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:12.379968    2559 patch_prober.go:28] interesting pod/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 20:07:12.380225 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:12.380031    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 20:07:13.380153 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:13.380120    2559 patch_prober.go:28] interesting pod/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 27 20:07:13.380336 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:13.380173    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 27 20:07:14.383101 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:14.383069    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:07:14.383511 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:14.383430    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:07:14.384146 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:14.384128    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:07:27.656338 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:27.656305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:07:34.987497 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:34.987414    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"]
Jul 27 20:07:34.987947 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:34.987636    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy" containerID="cri-o://2bf43f68b2b321a08671f5b47ef0850902135b8af800c939180e7e35a268d9c7" gracePeriod=30
Jul 27 20:07:37.892587 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:37.892553    2559 patch_prober.go:28] interesting pod/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 20:07:37.893073 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:37.892615    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 20:07:40.214477 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.214444    2559 generic.go:356] "Generic (PLEG): container finished" podID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerID="2bf43f68b2b321a08671f5b47ef0850902135b8af800c939180e7e35a268d9c7" exitCode=0
Jul 27 20:07:40.214929 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.214517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" event={"ID":"58cf445d-75ce-44b2-9497-6aca581b3fa3","Type":"ContainerDied","Data":"2bf43f68b2b321a08671f5b47ef0850902135b8af800c939180e7e35a268d9c7"}
Jul 27 20:07:40.214929 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.214600    2559 scope.go:117] "RemoveContainer" containerID="d1c9d755113067476ab0c2bcdade163e990efbe76f1a0068a4d9da619aa30def"
Jul 27 20:07:40.252338 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.252276    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:07:40.289240 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289202    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8plwt\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-kube-api-access-8plwt\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289425 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289268    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-credential-socket\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289425 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289299    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-podinfo\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289425 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-data\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289425 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289356    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-certs\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289654 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289430    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-socket\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289654 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289456    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-token\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289654 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289541    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-envoy\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289654 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289566    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cf445d-75ce-44b2-9497-6aca581b3fa3-istiod-ca-cert\") pod \"58cf445d-75ce-44b2-9497-6aca581b3fa3\" (UID: \"58cf445d-75ce-44b2-9497-6aca581b3fa3\") "
Jul 27 20:07:40.289654 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289640    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:40.289932 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289894    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:40.289987 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.289933    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.290280 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.290232    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:40.290280 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.290234    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cf445d-75ce-44b2-9497-6aca581b3fa3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:07:40.290407 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.290344    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-data" (OuterVolumeSpecName: "istio-data") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:40.292091 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.292045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:07:40.292091 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.292054    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-kube-api-access-8plwt" (OuterVolumeSpecName: "kube-api-access-8plwt") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "kube-api-access-8plwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:07:40.292272 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.292163    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-token" (OuterVolumeSpecName: "istio-token") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:07:40.292332 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.292261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58cf445d-75ce-44b2-9497-6aca581b3fa3" (UID: "58cf445d-75ce-44b2-9497-6aca581b3fa3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:07:40.390542 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390506    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.390542 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390537    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.390542 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390548    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.390814 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390556    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.390814 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390564    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.390814 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390572    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cf445d-75ce-44b2-9497-6aca581b3fa3-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.390814 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390579    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8plwt\" (UniqueName: \"kubernetes.io/projected/58cf445d-75ce-44b2-9497-6aca581b3fa3-kube-api-access-8plwt\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:40.390814 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:40.390590    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cf445d-75ce-44b2-9497-6aca581b3fa3-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:07:41.221124 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:41.221014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq" event={"ID":"58cf445d-75ce-44b2-9497-6aca581b3fa3","Type":"ContainerDied","Data":"96846159cde7c5d75f077c471b096c73a158b2c061d0ecf9cdc9c89bb6a53daf"}
Jul 27 20:07:41.221124 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:41.221052    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"
Jul 27 20:07:41.221124 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:41.221091    2559 scope.go:117] "RemoveContainer" containerID="2bf43f68b2b321a08671f5b47ef0850902135b8af800c939180e7e35a268d9c7"
Jul 27 20:07:41.237426 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:41.237392    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"]
Jul 27 20:07:41.239591 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:41.239567    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-110a90-openshift-default-c578f8b4d-h4jxq"]
Jul 27 20:07:42.942146 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:42.942110    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" path="/var/lib/kubelet/pods/58cf445d-75ce-44b2-9497-6aca581b3fa3/volumes"
Jul 27 20:07:55.158892 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:07:55.158845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:08:01.706102 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:01.706065    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"]
Jul 27 20:08:01.706567 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:01.706326    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy" containerID="cri-o://cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136" gracePeriod=30
Jul 27 20:08:02.618667 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.618629    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"]
Jul 27 20:08:02.619036 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619022    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy"
Jul 27 20:08:02.619092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619037    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy"
Jul 27 20:08:02.619092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619046    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy"
Jul 27 20:08:02.619092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619051    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy"
Jul 27 20:08:02.619092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619068    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy"
Jul 27 20:08:02.619092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619073    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy"
Jul 27 20:08:02.619252 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619134    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy"
Jul 27 20:08:02.619252 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.619142    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0359e66-105f-4765-a4d5-b85219d402d9" containerName="istio-proxy"
Jul 27 20:08:02.621619 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.621602    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.623949 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.623926    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-97e28d-openshift-default-dockercfg-9rm9m\""
Jul 27 20:08:02.632257 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.632230    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"]
Jul 27 20:08:02.703194 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f785cead-9e86-407c-b182-f9e0938bcd53-istiod-ca-cert\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.703534 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-certs\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.703672 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703545    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-envoy\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.703672 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f785cead-9e86-407c-b182-f9e0938bcd53-istio-podinfo\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.703796 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703667    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb26n\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-kube-api-access-wb26n\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.703796 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-credential-socket\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.703796 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-data\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.703796 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-socket\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.704043 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.703807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-istio-token\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805130 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f785cead-9e86-407c-b182-f9e0938bcd53-istiod-ca-cert\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805185    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-certs\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-envoy\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f785cead-9e86-407c-b182-f9e0938bcd53-istio-podinfo\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb26n\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-kube-api-access-wb26n\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-credential-socket\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-data\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805416    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-socket\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.805609 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-istio-token\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.806048 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.805975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f785cead-9e86-407c-b182-f9e0938bcd53-istiod-ca-cert\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.806115 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.806081    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-socket\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.806175 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.806160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-credential-socket\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.806233 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.806201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-data\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.806376 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.806356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-certs\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.808413 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.808389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-envoy\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.808525 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.808439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f785cead-9e86-407c-b182-f9e0938bcd53-istio-podinfo\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.812823 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.812799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-istio-token\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.813010 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.812992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb26n\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-kube-api-access-wb26n\") pod \"e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") " pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:02.933025 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:02.932992    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:03.071350 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.071276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"]
Jul 27 20:08:03.074239 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:08:03.074212    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf785cead_9e86_407c_b182_f9e0938bcd53.slice/crio-d0320882ee28896767437b660f354daa6d285d1c7c7222dc09c5673ebe283d6b WatchSource:0}: Error finding container d0320882ee28896767437b660f354daa6d285d1c7c7222dc09c5673ebe283d6b: Status 404 returned error can't find the container with id d0320882ee28896767437b660f354daa6d285d1c7c7222dc09c5673ebe283d6b
Jul 27 20:08:03.079804 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.079773    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:03.079905 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.079836    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:03.079905 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.079884    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:03.337026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.336920    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" event={"ID":"f785cead-9e86-407c-b182-f9e0938bcd53","Type":"ContainerStarted","Data":"48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795"}
Jul 27 20:08:03.337026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.336989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" event={"ID":"f785cead-9e86-407c-b182-f9e0938bcd53","Type":"ContainerStarted","Data":"d0320882ee28896767437b660f354daa6d285d1c7c7222dc09c5673ebe283d6b"}
Jul 27 20:08:03.355993 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.355927    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" podStartSLOduration=1.355904898 podStartE2EDuration="1.355904898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:03.355028722 +0000 UTC m=+2543.050584814" watchObservedRunningTime="2026-07-27 20:08:03.355904898 +0000 UTC m=+2543.051460992"
Jul 27 20:08:03.933577 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:03.933542    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:04.942342 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:04.942308    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:05.348117 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:05.348021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:05.349084 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:05.349064    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:06.968954 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:06.968891    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:08:07.046530 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046494    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-credential-socket\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.046530 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046532    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-podinfo\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.046778 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046554    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-data\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.046778 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046600    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-token\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.046778 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046642    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc4zm\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-kube-api-access-tc4zm\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.046778 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046681    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-socket\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.046778 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046712    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-envoy\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.046778 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-certs\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.047120 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046802    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e84633-25bc-44c5-9ad6-b93d6b209695-istiod-ca-cert\") pod \"b0e84633-25bc-44c5-9ad6-b93d6b209695\" (UID: \"b0e84633-25bc-44c5-9ad6-b93d6b209695\") "
Jul 27 20:08:07.047120 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.046806    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:08:07.047120 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.047035    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:08:07.047285 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.047233    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.047285 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.047252    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.047386 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.047344    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e84633-25bc-44c5-9ad6-b93d6b209695-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:08:07.047386 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.047361    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:08:07.047499 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.047378    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:08:07.048966 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.048931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:08:07.048966 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.048962    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:08:07.049154 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.049057    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:08:07.049248 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.049230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-kube-api-access-tc4zm" (OuterVolumeSpecName: "kube-api-access-tc4zm") pod "b0e84633-25bc-44c5-9ad6-b93d6b209695" (UID: "b0e84633-25bc-44c5-9ad6-b93d6b209695"). InnerVolumeSpecName "kube-api-access-tc4zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:08:07.147903 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.147847    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.147903 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.147899    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc4zm\" (UniqueName: \"kubernetes.io/projected/b0e84633-25bc-44c5-9ad6-b93d6b209695-kube-api-access-tc4zm\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.147903 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.147909    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.148134 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.147917    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.148134 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.147926    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e84633-25bc-44c5-9ad6-b93d6b209695-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.148134 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.147934    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.148134 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.147941    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e84633-25bc-44c5-9ad6-b93d6b209695-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:08:07.359318 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.359236    2559 generic.go:356] "Generic (PLEG): container finished" podID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerID="cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136" exitCode=0
Jul 27 20:08:07.359318 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.359282    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"
Jul 27 20:08:07.359541 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.359333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" event={"ID":"b0e84633-25bc-44c5-9ad6-b93d6b209695","Type":"ContainerDied","Data":"cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136"}
Jul 27 20:08:07.359541 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.359395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2" event={"ID":"b0e84633-25bc-44c5-9ad6-b93d6b209695","Type":"ContainerDied","Data":"ea5dd703362b09205e4360051a3b02670de52fc3ff706d523b03fab8443cfd8b"}
Jul 27 20:08:07.359541 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.359426    2559 scope.go:117] "RemoveContainer" containerID="cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136"
Jul 27 20:08:07.369360 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.369344    2559 scope.go:117] "RemoveContainer" containerID="67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0"
Jul 27 20:08:07.377249 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.377232    2559 scope.go:117] "RemoveContainer" containerID="cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136"
Jul 27 20:08:07.377498 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:08:07.377480    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136\": container with ID starting with cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136 not found: ID does not exist" containerID="cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136"
Jul 27 20:08:07.377555 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.377508    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136"} err="failed to get container status \"cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136\": rpc error: code = NotFound desc = could not find container \"cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136\": container with ID starting with cd8148b0d38293791fb7d43fd940496d9c7a549b55bd93ebe57182752f2c7136 not found: ID does not exist"
Jul 27 20:08:07.377555 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.377524    2559 scope.go:117] "RemoveContainer" containerID="67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0"
Jul 27 20:08:07.377738 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:08:07.377723    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0\": container with ID starting with 67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0 not found: ID does not exist" containerID="67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0"
Jul 27 20:08:07.377781 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.377741    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0"} err="failed to get container status \"67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0\": rpc error: code = NotFound desc = could not find container \"67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0\": container with ID starting with 67c7acdf6b1667521f104d6afcf9a6bc2992e12f4e846ecf540f82479c5aeef0 not found: ID does not exist"
Jul 27 20:08:07.380773 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.380750    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"]
Jul 27 20:08:07.386539 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:07.386518    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-16dc17-openshift-default-7675b6cc7d-crkx2"]
Jul 27 20:08:08.942241 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:08.942207    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" path="/var/lib/kubelet/pods/b0e84633-25bc-44c5-9ad6-b93d6b209695/volumes"
Jul 27 20:08:10.321286 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.321250    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"]
Jul 27 20:08:10.321711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.321697    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy"
Jul 27 20:08:10.321711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.321712    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy"
Jul 27 20:08:10.321806 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.321720    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy"
Jul 27 20:08:10.321806 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.321727    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy"
Jul 27 20:08:10.321953 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.321840    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy"
Jul 27 20:08:10.321953 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.321897    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cf445d-75ce-44b2-9497-6aca581b3fa3" containerName="istio-proxy"
Jul 27 20:08:10.325557 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.325539    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.327755 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.327738    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e837b8-openshift-default-dockercfg-fh2qq\""
Jul 27 20:08:10.337483 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.337460    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"]
Jul 27 20:08:10.476690 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-socket\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.476690 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-envoy\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.476925 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-podinfo\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.476925 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cmkf\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-kube-api-access-2cmkf\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.476925 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-credential-socket\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.477026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476935    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-token\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.477026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476968    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-certs\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.477026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.476990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b82f9bad-1f75-4f07-90d4-6f203f435e57-istiod-ca-cert\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.477026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.477019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-data\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.578520 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.578466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-podinfo\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.578711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.578547    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cmkf\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-kube-api-access-2cmkf\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.578711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.578583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-credential-socket\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.578711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.578650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-token\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.578711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.578693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-certs\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.578952 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.578720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b82f9bad-1f75-4f07-90d4-6f203f435e57-istiod-ca-cert\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.578952 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.578749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-data\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.579081 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.579040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-socket\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.579129 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.579090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-envoy\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.579178 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.579135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-certs\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.579239 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.579176    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-credential-socket\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.579239 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.579214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-data\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.579354 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.579302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-socket\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.579557 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.579535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b82f9bad-1f75-4f07-90d4-6f203f435e57-istiod-ca-cert\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.581023 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.581006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-podinfo\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.581250 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.581232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-envoy\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.587392 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.587367    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cmkf\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-kube-api-access-2cmkf\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.587591 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.587575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-token\") pod \"e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") " pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.635769 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.635748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:10.770599 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.770576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"]
Jul 27 20:08:10.772652 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:08:10.772623    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82f9bad_1f75_4f07_90d4_6f203f435e57.slice/crio-8f4426143975d67a7d64eab510597839f69dff2bc82203ccdb3fe72fd6095971 WatchSource:0}: Error finding container 8f4426143975d67a7d64eab510597839f69dff2bc82203ccdb3fe72fd6095971: Status 404 returned error can't find the container with id 8f4426143975d67a7d64eab510597839f69dff2bc82203ccdb3fe72fd6095971
Jul 27 20:08:10.774802 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.774770    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:10.774931 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.774835    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:10.774931 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:10.774879    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:11.381396 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:11.381349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" event={"ID":"b82f9bad-1f75-4f07-90d4-6f203f435e57","Type":"ContainerStarted","Data":"b81c6bff8da22b3cb83965b231e171a713108e8d916138926f2cf02b36705980"}
Jul 27 20:08:11.381781 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:11.381411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" event={"ID":"b82f9bad-1f75-4f07-90d4-6f203f435e57","Type":"ContainerStarted","Data":"8f4426143975d67a7d64eab510597839f69dff2bc82203ccdb3fe72fd6095971"}
Jul 27 20:08:11.403046 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:11.402995    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" podStartSLOduration=1.402980161 podStartE2EDuration="1.402980161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:11.401669355 +0000 UTC m=+2551.097225450" watchObservedRunningTime="2026-07-27 20:08:11.402980161 +0000 UTC m=+2551.098536330"
Jul 27 20:08:11.636408 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:11.636323    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:11.641265 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:11.641239    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:12.386883 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:12.386836    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:12.387689 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:12.387668    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:13.291129 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:13.291099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:08:20.934621 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:20.934352    2559 patch_prober.go:28] interesting pod/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": read tcp 10.132.0.2:40510->10.132.0.87:15021: read: connection reset by peer" start-of-body=
Jul 27 20:08:20.934621 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:20.934434    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": read tcp 10.132.0.2:40510->10.132.0.87:15021: read: connection reset by peer"
Jul 27 20:08:21.442102 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:21.442071    2559 generic.go:356] "Generic (PLEG): container finished" podID="f785cead-9e86-407c-b182-f9e0938bcd53" containerID="48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795" exitCode=0
Jul 27 20:08:21.442281 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:21.442139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" event={"ID":"f785cead-9e86-407c-b182-f9e0938bcd53","Type":"ContainerDied","Data":"48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795"}
Jul 27 20:08:21.442547 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:21.442534    2559 scope.go:117] "RemoveContainer" containerID="48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795"
Jul 27 20:08:21.443546 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:21.443519    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:21.443622 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:21.443610    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:21.443664 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:21.443643    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:22.454391 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:22.454347    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" event={"ID":"f785cead-9e86-407c-b182-f9e0938bcd53","Type":"ContainerStarted","Data":"2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc"}
Jul 27 20:08:22.933603 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:22.933565    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:22.934041 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:22.933939    2559 patch_prober.go:28] interesting pod/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 27 20:08:22.934233 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:22.934209    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 27 20:08:23.933818 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:23.933767    2559 patch_prober.go:28] interesting pod/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 27 20:08:23.934354 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:23.933839    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 27 20:08:24.934117 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:24.934070    2559 patch_prober.go:28] interesting pod/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 27 20:08:24.934644 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:24.934138    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 27 20:08:25.934970 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:25.934933    2559 patch_prober.go:28] interesting pod/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Jul 27 20:08:25.935565 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:25.935530    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Jul 27 20:08:26.942400 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:26.942368    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:26.942794 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:26.942721    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:26.943443 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:26.943425    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:08:27.666473 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:27.666433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:08:28.429017 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:28.428983    2559 patch_prober.go:28] interesting pod/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 20:08:28.429455 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:28.429044    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 20:08:29.492583 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:29.492551    2559 generic.go:356] "Generic (PLEG): container finished" podID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerID="b81c6bff8da22b3cb83965b231e171a713108e8d916138926f2cf02b36705980" exitCode=0
Jul 27 20:08:29.493110 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:29.492633    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" event={"ID":"b82f9bad-1f75-4f07-90d4-6f203f435e57","Type":"ContainerDied","Data":"b81c6bff8da22b3cb83965b231e171a713108e8d916138926f2cf02b36705980"}
Jul 27 20:08:29.493110 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:29.493093    2559 scope.go:117] "RemoveContainer" containerID="b81c6bff8da22b3cb83965b231e171a713108e8d916138926f2cf02b36705980"
Jul 27 20:08:29.494229 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:29.494199    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:29.494291 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:29.494279    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:29.494328 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:29.494319    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:08:30.499277 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:30.499240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" event={"ID":"b82f9bad-1f75-4f07-90d4-6f203f435e57","Type":"ContainerStarted","Data":"fd140750a11025a6c50e572be58bcf6a746d4b1b547ce8e72c41618283163711"}
Jul 27 20:08:30.636920 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:30.636885    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:30.637139 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:30.637113    2559 patch_prober.go:28] interesting pod/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 27 20:08:30.637226 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:30.637188    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 27 20:08:31.636957 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:31.636918    2559 patch_prober.go:28] interesting pod/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 27 20:08:31.637343 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:31.636988    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 27 20:08:32.636239 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:32.636197    2559 patch_prober.go:28] interesting pod/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 27 20:08:32.636422 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:32.636262    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 27 20:08:33.637104 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:33.637065    2559 patch_prober.go:28] interesting pod/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Jul 27 20:08:33.637586 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:33.637141    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Jul 27 20:08:34.639455 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:34.639427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:34.639898 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:34.639688    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:08:34.640527 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:08:34.640510    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:09:09.560601 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:09.560514    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:09:39.790867 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.790826    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"]
Jul 27 20:09:39.791354 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.791287    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e84633-25bc-44c5-9ad6-b93d6b209695" containerName="istio-proxy"
Jul 27 20:09:39.793728 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.793705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.796195 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.796168    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"kube-root-ca.crt\""
Jul 27 20:09:39.797158 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.797134    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"auth-test-model-e837b8-kserve-self-signed-certs\""
Jul 27 20:09:39.797313 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.797296    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"openshift-service-ca.crt\""
Jul 27 20:09:39.797363 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.797300    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"default-dockercfg-fwmk2\""
Jul 27 20:09:39.803356 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.803334    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"]
Jul 27 20:09:39.841802 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.841772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-model-cache\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.841992 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.841812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-dshm\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.841992 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.841840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jplw\" (UniqueName: \"kubernetes.io/projected/298a48d2-cf30-45a8-a427-112ace2c1cc0-kube-api-access-9jplw\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.841992 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.841920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-tmp-dir\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.841992 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.841976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-home\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.842159 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.842049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/298a48d2-cf30-45a8-a427-112ace2c1cc0-tls-certs\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.942706 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.942674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-home\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.942914 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.942762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/298a48d2-cf30-45a8-a427-112ace2c1cc0-tls-certs\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.943022 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.942991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-model-cache\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.943092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.943055    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-dshm\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.943150 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.943088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jplw\" (UniqueName: \"kubernetes.io/projected/298a48d2-cf30-45a8-a427-112ace2c1cc0-kube-api-access-9jplw\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.943150 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.943101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-home\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.943264 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.943144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-tmp-dir\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.943372 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.943354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-model-cache\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.943440 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.943422    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-tmp-dir\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.945133 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.945107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-dshm\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.945408 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.945389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/298a48d2-cf30-45a8-a427-112ace2c1cc0-tls-certs\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:39.950297 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:39.950270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jplw\" (UniqueName: \"kubernetes.io/projected/298a48d2-cf30-45a8-a427-112ace2c1cc0-kube-api-access-9jplw\") pod \"auth-test-model-e837b8-kserve-5474455db7-26bkl\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") " pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:40.105123 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:40.105027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:40.240299 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:40.240276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"]
Jul 27 20:09:40.854164 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:40.854118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl" event={"ID":"298a48d2-cf30-45a8-a427-112ace2c1cc0","Type":"ContainerStarted","Data":"17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2"}
Jul 27 20:09:40.854614 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:40.854173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl" event={"ID":"298a48d2-cf30-45a8-a427-112ace2c1cc0","Type":"ContainerStarted","Data":"43c020fb98d2944c5f54f1da486a77d7f9031451c35f901c692acb8b39809321"}
Jul 27 20:09:40.871571 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:40.871519    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl" podStartSLOduration=1.871504541 podStartE2EDuration="1.871504541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:09:40.870320024 +0000 UTC m=+2640.565876118" watchObservedRunningTime="2026-07-27 20:09:40.871504541 +0000 UTC m=+2640.567060635"
Jul 27 20:09:43.654630 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:43.654596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:09:50.105910 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:50.105846    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:50.106374 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:50.105931    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:50.119989 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:50.119962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:09:50.914976 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:09:50.914950    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:10:10.263300 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:10:10.263263    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:10:31.153605 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:10:31.153569    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:10:41.020717 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:10:41.020643    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:10:41.025293 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:10:41.025270    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:10:41.026525 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:10:41.026502    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:10:41.030866 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:10:41.030839    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:10:48.677500 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:10:48.677466    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:11:16.254334 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:11:16.254300    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:11:29.667075 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:11:29.667037    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:11:42.459359 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:11:42.459318    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:12:04.464741 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:12:04.464658    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:12:21.463374 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:12:21.463337    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:12:42.160556 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:12:42.160520    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:12:55.857624 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:12:55.857584    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:13:07.267445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:13:07.267409    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:13:25.257819 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:13:25.257783    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:13:44.161087 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:13:44.161000    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:14:06.460010 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:06.459971    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:14:11.875239 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:11.875203    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"]
Jul 27 20:14:22.864783 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:22.864746    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:14:26.894314 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:26.894271    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl" podUID="298a48d2-cf30-45a8-a427-112ace2c1cc0" containerName="main" containerID="cri-o://17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2" gracePeriod=45
Jul 27 20:14:27.164172 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.164148    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:14:27.221822 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.221792    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-dshm\") pod \"298a48d2-cf30-45a8-a427-112ace2c1cc0\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") "
Jul 27 20:14:27.221983 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.221839    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-tmp-dir\") pod \"298a48d2-cf30-45a8-a427-112ace2c1cc0\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") "
Jul 27 20:14:27.221983 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.221884    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-home\") pod \"298a48d2-cf30-45a8-a427-112ace2c1cc0\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") "
Jul 27 20:14:27.221983 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.221923    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jplw\" (UniqueName: \"kubernetes.io/projected/298a48d2-cf30-45a8-a427-112ace2c1cc0-kube-api-access-9jplw\") pod \"298a48d2-cf30-45a8-a427-112ace2c1cc0\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") "
Jul 27 20:14:27.222133 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.221997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/298a48d2-cf30-45a8-a427-112ace2c1cc0-tls-certs\") pod \"298a48d2-cf30-45a8-a427-112ace2c1cc0\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") "
Jul 27 20:14:27.222133 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.222021    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-model-cache\") pod \"298a48d2-cf30-45a8-a427-112ace2c1cc0\" (UID: \"298a48d2-cf30-45a8-a427-112ace2c1cc0\") "
Jul 27 20:14:27.222246 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.222160    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-home" (OuterVolumeSpecName: "home") pod "298a48d2-cf30-45a8-a427-112ace2c1cc0" (UID: "298a48d2-cf30-45a8-a427-112ace2c1cc0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:14:27.222246 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.222174    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "298a48d2-cf30-45a8-a427-112ace2c1cc0" (UID: "298a48d2-cf30-45a8-a427-112ace2c1cc0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:14:27.222372 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.222349    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-tmp-dir\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:14:27.222372 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.222367    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-home\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:14:27.222455 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.222365    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-model-cache" (OuterVolumeSpecName: "model-cache") pod "298a48d2-cf30-45a8-a427-112ace2c1cc0" (UID: "298a48d2-cf30-45a8-a427-112ace2c1cc0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:14:27.224039 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.224015    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-dshm" (OuterVolumeSpecName: "dshm") pod "298a48d2-cf30-45a8-a427-112ace2c1cc0" (UID: "298a48d2-cf30-45a8-a427-112ace2c1cc0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:14:27.224140 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.224057    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/298a48d2-cf30-45a8-a427-112ace2c1cc0-kube-api-access-9jplw" (OuterVolumeSpecName: "kube-api-access-9jplw") pod "298a48d2-cf30-45a8-a427-112ace2c1cc0" (UID: "298a48d2-cf30-45a8-a427-112ace2c1cc0"). InnerVolumeSpecName "kube-api-access-9jplw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:14:27.224140 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.224079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/298a48d2-cf30-45a8-a427-112ace2c1cc0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "298a48d2-cf30-45a8-a427-112ace2c1cc0" (UID: "298a48d2-cf30-45a8-a427-112ace2c1cc0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:14:27.322996 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.322968    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-dshm\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:14:27.322996 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.322995    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jplw\" (UniqueName: \"kubernetes.io/projected/298a48d2-cf30-45a8-a427-112ace2c1cc0-kube-api-access-9jplw\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:14:27.323200 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.323008    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/298a48d2-cf30-45a8-a427-112ace2c1cc0-tls-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:14:27.323200 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.323017    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/298a48d2-cf30-45a8-a427-112ace2c1cc0-model-cache\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:14:27.323200 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.323148    2559 generic.go:356] "Generic (PLEG): container finished" podID="298a48d2-cf30-45a8-a427-112ace2c1cc0" containerID="17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2" exitCode=0
Jul 27 20:14:27.323200 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.323186    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"
Jul 27 20:14:27.323331 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.323235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl" event={"ID":"298a48d2-cf30-45a8-a427-112ace2c1cc0","Type":"ContainerDied","Data":"17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2"}
Jul 27 20:14:27.323331 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.323282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl" event={"ID":"298a48d2-cf30-45a8-a427-112ace2c1cc0","Type":"ContainerDied","Data":"43c020fb98d2944c5f54f1da486a77d7f9031451c35f901c692acb8b39809321"}
Jul 27 20:14:27.323698 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.323307    2559 scope.go:117] "RemoveContainer" containerID="17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2"
Jul 27 20:14:27.339837 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.339814    2559 scope.go:117] "RemoveContainer" containerID="17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2"
Jul 27 20:14:27.340141 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:14:27.340119    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2\": container with ID starting with 17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2 not found: ID does not exist" containerID="17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2"
Jul 27 20:14:27.340234 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.340147    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2"} err="failed to get container status \"17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2\": rpc error: code = NotFound desc = could not find container \"17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2\": container with ID starting with 17830756e222fd30e4825dbb114f314628276dd80c58f3ef5cbd4a723600d8e2 not found: ID does not exist"
Jul 27 20:14:27.348323 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.348286    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"]
Jul 27 20:14:27.350458 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:27.350436    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/auth-test-model-e837b8-kserve-5474455db7-26bkl"]
Jul 27 20:14:28.942249 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:28.942217    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="298a48d2-cf30-45a8-a427-112ace2c1cc0" path="/var/lib/kubelet/pods/298a48d2-cf30-45a8-a427-112ace2c1cc0/volumes"
Jul 27 20:14:32.364538 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:14:32.364510    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:15:04.290181 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.290101    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"]
Jul 27 20:15:04.290644 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.290617    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="298a48d2-cf30-45a8-a427-112ace2c1cc0" containerName="main"
Jul 27 20:15:04.290708 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.290645    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="298a48d2-cf30-45a8-a427-112ace2c1cc0" containerName="main"
Jul 27 20:15:04.290789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.290775    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="298a48d2-cf30-45a8-a427-112ace2c1cc0" containerName="main"
Jul 27 20:15:04.293294 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.293274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.296581 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.296553    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"default-dockercfg-fwmk2\""
Jul 27 20:15:04.296704 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.296634    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"openshift-service-ca.crt\""
Jul 27 20:15:04.296704 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.296691    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"kube-root-ca.crt\""
Jul 27 20:15:04.296806 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.296789    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e837b8\"/\"sub-test-model-e837b8-kserve-self-signed-certs\""
Jul 27 20:15:04.301414 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.301221    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"]
Jul 27 20:15:04.376992 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.376947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tls-certs\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.377171 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.377023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-model-cache\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.377171 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.377047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tmp-dir\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.377171 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.377073    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzp4r\" (UniqueName: \"kubernetes.io/projected/38b167d6-998e-4db3-8b00-fdbbb95eb39c-kube-api-access-lzp4r\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.377171 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.377120    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-home\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.377171 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.377141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-dshm\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.477769 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.477730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-model-cache\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.477769 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.477771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tmp-dir\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.478038 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.477809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzp4r\" (UniqueName: \"kubernetes.io/projected/38b167d6-998e-4db3-8b00-fdbbb95eb39c-kube-api-access-lzp4r\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.478038 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.477877    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-home\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.478148 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.478053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-dshm\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.478201 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.478153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tls-certs\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.478245 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.478209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-model-cache\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.478245 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.478233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-home\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.478329 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.478270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tmp-dir\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.480366 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.480342    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-dshm\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.480484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.480467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tls-certs\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.488588 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.487869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzp4r\" (UniqueName: \"kubernetes.io/projected/38b167d6-998e-4db3-8b00-fdbbb95eb39c-kube-api-access-lzp4r\") pod \"sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") " pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.604052 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.603944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:04.741730 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:04.741701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"]
Jul 27 20:15:04.743525 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:15:04.743496    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38b167d6_998e_4db3_8b00_fdbbb95eb39c.slice/crio-a91b9ae26219d7252cb7c65e521c1dff56ec8e67b956c3813b43de8fa1c60031 WatchSource:0}: Error finding container a91b9ae26219d7252cb7c65e521c1dff56ec8e67b956c3813b43de8fa1c60031: Status 404 returned error can't find the container with id a91b9ae26219d7252cb7c65e521c1dff56ec8e67b956c3813b43de8fa1c60031
Jul 27 20:15:05.522150 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:05.522116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh" event={"ID":"38b167d6-998e-4db3-8b00-fdbbb95eb39c","Type":"ContainerStarted","Data":"dd9dcddb6b944075576f8f491a4e75f80b8f3b78876747357921ecbc787edcb3"}
Jul 27 20:15:05.522150 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:05.522159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh" event={"ID":"38b167d6-998e-4db3-8b00-fdbbb95eb39c","Type":"ContainerStarted","Data":"a91b9ae26219d7252cb7c65e521c1dff56ec8e67b956c3813b43de8fa1c60031"}
Jul 27 20:15:05.539431 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:05.539381    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh" podStartSLOduration=1.539365241 podStartE2EDuration="1.539365241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:05.537701138 +0000 UTC m=+2965.233257233" watchObservedRunningTime="2026-07-27 20:15:05.539365241 +0000 UTC m=+2965.234921334"
Jul 27 20:15:08.159304 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:08.159271    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:15:14.604153 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:14.604117    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:14.604639 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:14.604194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:14.616841 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:14.616812    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:15.582058 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:15.582028    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:15:40.755389 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:40.755354    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:15:41.050156 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:41.050082    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:15:41.054521 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:41.054498    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:15:41.058431 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:41.058407    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:15:41.062820 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:41.062804    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:15:58.561698 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:15:58.561665    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:16:14.261424 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:14.261390    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:16:21.783222 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:21.783188    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"]
Jul 27 20:16:31.857047 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:31.857008    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:16:36.802505 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:36.802466    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh" podUID="38b167d6-998e-4db3-8b00-fdbbb95eb39c" containerName="main" containerID="cri-o://dd9dcddb6b944075576f8f491a4e75f80b8f3b78876747357921ecbc787edcb3" gracePeriod=45
Jul 27 20:16:36.982377 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:36.982344    2559 generic.go:356] "Generic (PLEG): container finished" podID="38b167d6-998e-4db3-8b00-fdbbb95eb39c" containerID="dd9dcddb6b944075576f8f491a4e75f80b8f3b78876747357921ecbc787edcb3" exitCode=0
Jul 27 20:16:36.982530 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:36.982407    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh" event={"ID":"38b167d6-998e-4db3-8b00-fdbbb95eb39c","Type":"ContainerDied","Data":"dd9dcddb6b944075576f8f491a4e75f80b8f3b78876747357921ecbc787edcb3"}
Jul 27 20:16:37.068932 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.068909    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:16:37.175976 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.175926    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-home\") pod \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") "
Jul 27 20:16:37.176190 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176001    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tmp-dir\") pod \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") "
Jul 27 20:16:37.176190 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176055    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tls-certs\") pod \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") "
Jul 27 20:16:37.176190 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176095    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzp4r\" (UniqueName: \"kubernetes.io/projected/38b167d6-998e-4db3-8b00-fdbbb95eb39c-kube-api-access-lzp4r\") pod \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") "
Jul 27 20:16:37.176190 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176117    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-dshm\") pod \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") "
Jul 27 20:16:37.176421 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-home" (OuterVolumeSpecName: "home") pod "38b167d6-998e-4db3-8b00-fdbbb95eb39c" (UID: "38b167d6-998e-4db3-8b00-fdbbb95eb39c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:16:37.176421 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176203    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-model-cache\") pod \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\" (UID: \"38b167d6-998e-4db3-8b00-fdbbb95eb39c\") "
Jul 27 20:16:37.176421 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176248    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38b167d6-998e-4db3-8b00-fdbbb95eb39c" (UID: "38b167d6-998e-4db3-8b00-fdbbb95eb39c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:16:37.176421 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176409    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-model-cache" (OuterVolumeSpecName: "model-cache") pod "38b167d6-998e-4db3-8b00-fdbbb95eb39c" (UID: "38b167d6-998e-4db3-8b00-fdbbb95eb39c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:16:37.176615 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176514    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-model-cache\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:16:37.176615 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176527    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-home\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:16:37.176615 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.176535    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tmp-dir\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:16:37.178277 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.178252    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-dshm" (OuterVolumeSpecName: "dshm") pod "38b167d6-998e-4db3-8b00-fdbbb95eb39c" (UID: "38b167d6-998e-4db3-8b00-fdbbb95eb39c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:16:37.178415 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.178385    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b167d6-998e-4db3-8b00-fdbbb95eb39c-kube-api-access-lzp4r" (OuterVolumeSpecName: "kube-api-access-lzp4r") pod "38b167d6-998e-4db3-8b00-fdbbb95eb39c" (UID: "38b167d6-998e-4db3-8b00-fdbbb95eb39c"). InnerVolumeSpecName "kube-api-access-lzp4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:16:37.178415 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.178313    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38b167d6-998e-4db3-8b00-fdbbb95eb39c" (UID: "38b167d6-998e-4db3-8b00-fdbbb95eb39c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 20:16:37.277747 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.277688    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38b167d6-998e-4db3-8b00-fdbbb95eb39c-tls-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:16:37.277747 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.277738    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzp4r\" (UniqueName: \"kubernetes.io/projected/38b167d6-998e-4db3-8b00-fdbbb95eb39c-kube-api-access-lzp4r\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:16:37.277747 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.277753    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38b167d6-998e-4db3-8b00-fdbbb95eb39c-dshm\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:16:37.989153 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.989118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh" event={"ID":"38b167d6-998e-4db3-8b00-fdbbb95eb39c","Type":"ContainerDied","Data":"a91b9ae26219d7252cb7c65e521c1dff56ec8e67b956c3813b43de8fa1c60031"}
Jul 27 20:16:37.989153 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.989144    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"
Jul 27 20:16:37.989674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:37.989170    2559 scope.go:117] "RemoveContainer" containerID="dd9dcddb6b944075576f8f491a4e75f80b8f3b78876747357921ecbc787edcb3"
Jul 27 20:16:38.010201 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:38.010168    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"]
Jul 27 20:16:38.012653 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:38.012631    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e837b8/sub-test-model-e837b8-kserve-5b4bdf77f7-lz9nh"]
Jul 27 20:16:38.942281 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:38.942246    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38b167d6-998e-4db3-8b00-fdbbb95eb39c" path="/var/lib/kubelet/pods/38b167d6-998e-4db3-8b00-fdbbb95eb39c/volumes"
Jul 27 20:16:50.866907 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:16:50.866871    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:17:09.757152 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:17:09.757110    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:17:40.366873 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:17:40.366825    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:17:54.669275 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:17:54.669238    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:18:09.657925 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:09.657832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:18:15.948802 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:15.948766    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7498-139788215794096"]
Jul 27 20:18:15.949237 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:15.949171    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b167d6-998e-4db3-8b00-fdbbb95eb39c" containerName="main"
Jul 27 20:18:15.949237 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:15.949182    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b167d6-998e-4db3-8b00-fdbbb95eb39c" containerName="main"
Jul 27 20:18:15.949323 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:15.949249    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b167d6-998e-4db3-8b00-fdbbb95eb39c" containerName="main"
Jul 27 20:18:15.951889 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:15.951871    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215794096"
Jul 27 20:18:15.954067 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:15.954047    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zbdwp\""
Jul 27 20:18:15.958206 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:15.958176    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215794096"]
Jul 27 20:18:16.117925 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:16.117888    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw649\" (UniqueName: \"kubernetes.io/projected/28bc3446-618d-4e7a-8f51-8b3f5acc6f0c-kube-api-access-bw649\") pod \"test-curl-7498-139788215794096\" (UID: \"28bc3446-618d-4e7a-8f51-8b3f5acc6f0c\") " pod="opendatahub/test-curl-7498-139788215794096"
Jul 27 20:18:16.219218 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:16.219129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw649\" (UniqueName: \"kubernetes.io/projected/28bc3446-618d-4e7a-8f51-8b3f5acc6f0c-kube-api-access-bw649\") pod \"test-curl-7498-139788215794096\" (UID: \"28bc3446-618d-4e7a-8f51-8b3f5acc6f0c\") " pod="opendatahub/test-curl-7498-139788215794096"
Jul 27 20:18:16.227349 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:16.227317    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw649\" (UniqueName: \"kubernetes.io/projected/28bc3446-618d-4e7a-8f51-8b3f5acc6f0c-kube-api-access-bw649\") pod \"test-curl-7498-139788215794096\" (UID: \"28bc3446-618d-4e7a-8f51-8b3f5acc6f0c\") " pod="opendatahub/test-curl-7498-139788215794096"
Jul 27 20:18:16.262712 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:16.262679    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215794096"
Jul 27 20:18:16.399385 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:16.399354    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215794096"]
Jul 27 20:18:16.401376 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:18:16.401345    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28bc3446_618d_4e7a_8f51_8b3f5acc6f0c.slice/crio-385640d0727976161db303b190450905f6f2a1350c03c5f0025d80e2399d0c26 WatchSource:0}: Error finding container 385640d0727976161db303b190450905f6f2a1350c03c5f0025d80e2399d0c26: Status 404 returned error can't find the container with id 385640d0727976161db303b190450905f6f2a1350c03c5f0025d80e2399d0c26
Jul 27 20:18:16.402611 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:16.402594    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:18:16.501084 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:16.500998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215794096" event={"ID":"28bc3446-618d-4e7a-8f51-8b3f5acc6f0c","Type":"ContainerStarted","Data":"385640d0727976161db303b190450905f6f2a1350c03c5f0025d80e2399d0c26"}
Jul 27 20:18:17.507400 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:17.507365    2559 generic.go:356] "Generic (PLEG): container finished" podID="28bc3446-618d-4e7a-8f51-8b3f5acc6f0c" containerID="9b942981ccb9cefeb7378b91bf5ee2bd33b33127c1f028e0b707853a18fb5152" exitCode=0
Jul 27 20:18:17.507790 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:17.507458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215794096" event={"ID":"28bc3446-618d-4e7a-8f51-8b3f5acc6f0c","Type":"ContainerDied","Data":"9b942981ccb9cefeb7378b91bf5ee2bd33b33127c1f028e0b707853a18fb5152"}
Jul 27 20:18:18.653031 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.653005    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215794096"
Jul 27 20:18:18.686334 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.686303    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7498-139788215794096_28bc3446-618d-4e7a-8f51-8b3f5acc6f0c/test-curl-7498-139788215794096/0.log"
Jul 27 20:18:18.709012 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.708981    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7498-139788215794096"]
Jul 27 20:18:18.712211 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.712187    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7498-139788215794096"]
Jul 27 20:18:18.832793 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.832711    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7498-139788215772592"]
Jul 27 20:18:18.833349 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.833320    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28bc3446-618d-4e7a-8f51-8b3f5acc6f0c" containerName="test-curl-7498-139788215794096"
Jul 27 20:18:18.833349 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.833348    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="28bc3446-618d-4e7a-8f51-8b3f5acc6f0c" containerName="test-curl-7498-139788215794096"
Jul 27 20:18:18.833551 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.833468    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="28bc3446-618d-4e7a-8f51-8b3f5acc6f0c" containerName="test-curl-7498-139788215794096"
Jul 27 20:18:18.836604 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.836585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:18.844236 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.844204    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw649\" (UniqueName: \"kubernetes.io/projected/28bc3446-618d-4e7a-8f51-8b3f5acc6f0c-kube-api-access-bw649\") pod \"28bc3446-618d-4e7a-8f51-8b3f5acc6f0c\" (UID: \"28bc3446-618d-4e7a-8f51-8b3f5acc6f0c\") "
Jul 27 20:18:18.844956 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.844389    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215772592"]
Jul 27 20:18:18.847788 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.847402    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28bc3446-618d-4e7a-8f51-8b3f5acc6f0c-kube-api-access-bw649" (OuterVolumeSpecName: "kube-api-access-bw649") pod "28bc3446-618d-4e7a-8f51-8b3f5acc6f0c" (UID: "28bc3446-618d-4e7a-8f51-8b3f5acc6f0c"). InnerVolumeSpecName "kube-api-access-bw649". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:18.943758 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.943724    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28bc3446-618d-4e7a-8f51-8b3f5acc6f0c" path="/var/lib/kubelet/pods/28bc3446-618d-4e7a-8f51-8b3f5acc6f0c/volumes"
Jul 27 20:18:18.944966 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.944925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-527k2\" (UniqueName: \"kubernetes.io/projected/91ece607-ce81-479f-86a1-c9673c05634a-kube-api-access-527k2\") pod \"test-curl-7498-139788215772592\" (UID: \"91ece607-ce81-479f-86a1-c9673c05634a\") " pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:18.945155 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:18.945031    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw649\" (UniqueName: \"kubernetes.io/projected/28bc3446-618d-4e7a-8f51-8b3f5acc6f0c-kube-api-access-bw649\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:18:19.045819 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:19.045785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-527k2\" (UniqueName: \"kubernetes.io/projected/91ece607-ce81-479f-86a1-c9673c05634a-kube-api-access-527k2\") pod \"test-curl-7498-139788215772592\" (UID: \"91ece607-ce81-479f-86a1-c9673c05634a\") " pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:19.053267 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:19.053239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-527k2\" (UniqueName: \"kubernetes.io/projected/91ece607-ce81-479f-86a1-c9673c05634a-kube-api-access-527k2\") pod \"test-curl-7498-139788215772592\" (UID: \"91ece607-ce81-479f-86a1-c9673c05634a\") " pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:19.147177 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:19.147087    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:19.282063 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:19.282035    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215772592"]
Jul 27 20:18:19.283836 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:18:19.283813    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91ece607_ce81_479f_86a1_c9673c05634a.slice/crio-ea5f253d4b45e48236021ef1ecf95dfee5d14d8321b60a6ad15790a8894889a5 WatchSource:0}: Error finding container ea5f253d4b45e48236021ef1ecf95dfee5d14d8321b60a6ad15790a8894889a5: Status 404 returned error can't find the container with id ea5f253d4b45e48236021ef1ecf95dfee5d14d8321b60a6ad15790a8894889a5
Jul 27 20:18:19.519770 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:19.519739    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215794096"
Jul 27 20:18:19.519980 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:19.519789    2559 scope.go:117] "RemoveContainer" containerID="9b942981ccb9cefeb7378b91bf5ee2bd33b33127c1f028e0b707853a18fb5152"
Jul 27 20:18:19.521188 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:19.521019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215772592" event={"ID":"91ece607-ce81-479f-86a1-c9673c05634a","Type":"ContainerStarted","Data":"ea5f253d4b45e48236021ef1ecf95dfee5d14d8321b60a6ad15790a8894889a5"}
Jul 27 20:18:20.528619 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:20.528584    2559 generic.go:356] "Generic (PLEG): container finished" podID="91ece607-ce81-479f-86a1-c9673c05634a" containerID="61efe3e99e67ac7e427d46ba3814a2885870bbb386d0c37dd08081f7f65e2a9f" exitCode=0
Jul 27 20:18:20.529118 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:20.528632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215772592" event={"ID":"91ece607-ce81-479f-86a1-c9673c05634a","Type":"ContainerDied","Data":"61efe3e99e67ac7e427d46ba3814a2885870bbb386d0c37dd08081f7f65e2a9f"}
Jul 27 20:18:21.676092 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.676067    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:21.695129 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.695101    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7498-139788215772592_91ece607-ce81-479f-86a1-c9673c05634a/test-curl-7498-139788215772592/0.log"
Jul 27 20:18:21.717452 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.717428    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7498-139788215772592"]
Jul 27 20:18:21.722688 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.722660    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7498-139788215772592"]
Jul 27 20:18:21.768593 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.768567    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-527k2\" (UniqueName: \"kubernetes.io/projected/91ece607-ce81-479f-86a1-c9673c05634a-kube-api-access-527k2\") pod \"91ece607-ce81-479f-86a1-c9673c05634a\" (UID: \"91ece607-ce81-479f-86a1-c9673c05634a\") "
Jul 27 20:18:21.770571 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.770542    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ece607-ce81-479f-86a1-c9673c05634a-kube-api-access-527k2" (OuterVolumeSpecName: "kube-api-access-527k2") pod "91ece607-ce81-479f-86a1-c9673c05634a" (UID: "91ece607-ce81-479f-86a1-c9673c05634a"). InnerVolumeSpecName "kube-api-access-527k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:21.869583 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.869500    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-527k2\" (UniqueName: \"kubernetes.io/projected/91ece607-ce81-479f-86a1-c9673c05634a-kube-api-access-527k2\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:18:21.887061 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.887028    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:21.887424 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.887410    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ece607-ce81-479f-86a1-c9673c05634a" containerName="test-curl-7498-139788215772592"
Jul 27 20:18:21.887466 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.887426    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ece607-ce81-479f-86a1-c9673c05634a" containerName="test-curl-7498-139788215772592"
Jul 27 20:18:21.887527 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.887518    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ece607-ce81-479f-86a1-c9673c05634a" containerName="test-curl-7498-139788215772592"
Jul 27 20:18:21.890450 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.890434    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:21.896591 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.896566    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:21.970057 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:21.970022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rssb7\" (UniqueName: \"kubernetes.io/projected/659e5ce6-729d-443f-bd38-7d10f49066b9-kube-api-access-rssb7\") pod \"test-curl-7498-139788215646224\" (UID: \"659e5ce6-729d-443f-bd38-7d10f49066b9\") " pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:22.070843 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.070800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rssb7\" (UniqueName: \"kubernetes.io/projected/659e5ce6-729d-443f-bd38-7d10f49066b9-kube-api-access-rssb7\") pod \"test-curl-7498-139788215646224\" (UID: \"659e5ce6-729d-443f-bd38-7d10f49066b9\") " pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:22.078303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.078275    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rssb7\" (UniqueName: \"kubernetes.io/projected/659e5ce6-729d-443f-bd38-7d10f49066b9-kube-api-access-rssb7\") pod \"test-curl-7498-139788215646224\" (UID: \"659e5ce6-729d-443f-bd38-7d10f49066b9\") " pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:22.202339 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.202286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:22.339970 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.339887    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:22.342204 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:18:22.342181    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod659e5ce6_729d_443f_bd38_7d10f49066b9.slice/crio-91b07dc6a0c1215add77d5e9d1cb54a565cda6e3434b4511fd187f5e280cb3b3 WatchSource:0}: Error finding container 91b07dc6a0c1215add77d5e9d1cb54a565cda6e3434b4511fd187f5e280cb3b3: Status 404 returned error can't find the container with id 91b07dc6a0c1215add77d5e9d1cb54a565cda6e3434b4511fd187f5e280cb3b3
Jul 27 20:18:22.541223 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.541142    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:22.541223 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.541186    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea5f253d4b45e48236021ef1ecf95dfee5d14d8321b60a6ad15790a8894889a5"
Jul 27 20:18:22.542410 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.542385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215646224" event={"ID":"659e5ce6-729d-443f-bd38-7d10f49066b9","Type":"ContainerStarted","Data":"91b07dc6a0c1215add77d5e9d1cb54a565cda6e3434b4511fd187f5e280cb3b3"}
Jul 27 20:18:22.552178 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:18:22.552149    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7498-139788215772592\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="91ece607-ce81-479f-86a1-c9673c05634a" pod="opendatahub/test-curl-7498-139788215772592"
Jul 27 20:18:22.943315 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:22.943283    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ece607-ce81-479f-86a1-c9673c05634a" path="/var/lib/kubelet/pods/91ece607-ce81-479f-86a1-c9673c05634a/volumes"
Jul 27 20:18:23.549153 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:23.549118    2559 generic.go:356] "Generic (PLEG): container finished" podID="659e5ce6-729d-443f-bd38-7d10f49066b9" containerID="dcf9d3fe74905f0f095ecf141b836cc9b58fc2f5e78225a1644a32775ab795d3" exitCode=0
Jul 27 20:18:23.549376 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:23.549203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215646224" event={"ID":"659e5ce6-729d-443f-bd38-7d10f49066b9","Type":"ContainerDied","Data":"dcf9d3fe74905f0f095ecf141b836cc9b58fc2f5e78225a1644a32775ab795d3"}
Jul 27 20:18:24.696770 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.696744    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:24.715697 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.715663    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7498-139788215646224_659e5ce6-729d-443f-bd38-7d10f49066b9/test-curl-7498-139788215646224/0.log"
Jul 27 20:18:24.736945 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.736910    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:24.738831 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.738802    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:24.792254 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.792218    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rssb7\" (UniqueName: \"kubernetes.io/projected/659e5ce6-729d-443f-bd38-7d10f49066b9-kube-api-access-rssb7\") pod \"659e5ce6-729d-443f-bd38-7d10f49066b9\" (UID: \"659e5ce6-729d-443f-bd38-7d10f49066b9\") "
Jul 27 20:18:24.794336 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.794314    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/659e5ce6-729d-443f-bd38-7d10f49066b9-kube-api-access-rssb7" (OuterVolumeSpecName: "kube-api-access-rssb7") pod "659e5ce6-729d-443f-bd38-7d10f49066b9" (UID: "659e5ce6-729d-443f-bd38-7d10f49066b9"). InnerVolumeSpecName "kube-api-access-rssb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:24.856080 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.855926    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:24.857097 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.857069    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="659e5ce6-729d-443f-bd38-7d10f49066b9" containerName="test-curl-7498-139788215646224"
Jul 27 20:18:24.857260 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.857248    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="659e5ce6-729d-443f-bd38-7d10f49066b9" containerName="test-curl-7498-139788215646224"
Jul 27 20:18:24.857593 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.857576    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="659e5ce6-729d-443f-bd38-7d10f49066b9" containerName="test-curl-7498-139788215646224"
Jul 27 20:18:24.861752 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.861719    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:24.862065 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.862040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:24.893049 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.893011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wj5j\" (UniqueName: \"kubernetes.io/projected/734a3c92-4634-4e79-a547-bc5aa0afe650-kube-api-access-9wj5j\") pod \"test-curl-7498-139788215646224\" (UID: \"734a3c92-4634-4e79-a547-bc5aa0afe650\") " pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:24.893195 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.893077    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rssb7\" (UniqueName: \"kubernetes.io/projected/659e5ce6-729d-443f-bd38-7d10f49066b9-kube-api-access-rssb7\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:18:24.942136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.942102    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="659e5ce6-729d-443f-bd38-7d10f49066b9" path="/var/lib/kubelet/pods/659e5ce6-729d-443f-bd38-7d10f49066b9/volumes"
Jul 27 20:18:24.993568 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:24.993539    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wj5j\" (UniqueName: \"kubernetes.io/projected/734a3c92-4634-4e79-a547-bc5aa0afe650-kube-api-access-9wj5j\") pod \"test-curl-7498-139788215646224\" (UID: \"734a3c92-4634-4e79-a547-bc5aa0afe650\") " pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:25.004733 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:25.004708    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wj5j\" (UniqueName: \"kubernetes.io/projected/734a3c92-4634-4e79-a547-bc5aa0afe650-kube-api-access-9wj5j\") pod \"test-curl-7498-139788215646224\" (UID: \"734a3c92-4634-4e79-a547-bc5aa0afe650\") " pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:25.174572 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:25.174486    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:25.303545 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:25.303520    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:25.305395 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:18:25.305367    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod734a3c92_4634_4e79_a547_bc5aa0afe650.slice/crio-c7687b529548e2d78841b1b39e96ba4db8490832e16065720bfc3d7bdd05a550 WatchSource:0}: Error finding container c7687b529548e2d78841b1b39e96ba4db8490832e16065720bfc3d7bdd05a550: Status 404 returned error can't find the container with id c7687b529548e2d78841b1b39e96ba4db8490832e16065720bfc3d7bdd05a550
Jul 27 20:18:25.560447 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:25.560412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215646224" event={"ID":"734a3c92-4634-4e79-a547-bc5aa0afe650","Type":"ContainerStarted","Data":"c7687b529548e2d78841b1b39e96ba4db8490832e16065720bfc3d7bdd05a550"}
Jul 27 20:18:25.561618 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:25.561597    2559 scope.go:117] "RemoveContainer" containerID="dcf9d3fe74905f0f095ecf141b836cc9b58fc2f5e78225a1644a32775ab795d3"
Jul 27 20:18:25.561724 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:25.561630    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:26.569711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:26.569678    2559 generic.go:356] "Generic (PLEG): container finished" podID="734a3c92-4634-4e79-a547-bc5aa0afe650" containerID="77e9cf95d4d43a5e3476597ec97e0b684bc62fcf34710b093495145b5fa04a23" exitCode=0
Jul 27 20:18:26.570136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:26.569806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215646224" event={"ID":"734a3c92-4634-4e79-a547-bc5aa0afe650","Type":"ContainerDied","Data":"77e9cf95d4d43a5e3476597ec97e0b684bc62fcf34710b093495145b5fa04a23"}
Jul 27 20:18:27.067229 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.067192    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:18:27.719622 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.719597    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:27.738568 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.738541    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7498-139788215646224_734a3c92-4634-4e79-a547-bc5aa0afe650/test-curl-7498-139788215646224/0.log"
Jul 27 20:18:27.759646 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.759618    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:27.763164 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.763144    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7498-139788215646224"]
Jul 27 20:18:27.815224 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.815184    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wj5j\" (UniqueName: \"kubernetes.io/projected/734a3c92-4634-4e79-a547-bc5aa0afe650-kube-api-access-9wj5j\") pod \"734a3c92-4634-4e79-a547-bc5aa0afe650\" (UID: \"734a3c92-4634-4e79-a547-bc5aa0afe650\") "
Jul 27 20:18:27.817270 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.817248    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734a3c92-4634-4e79-a547-bc5aa0afe650-kube-api-access-9wj5j" (OuterVolumeSpecName: "kube-api-access-9wj5j") pod "734a3c92-4634-4e79-a547-bc5aa0afe650" (UID: "734a3c92-4634-4e79-a547-bc5aa0afe650"). InnerVolumeSpecName "kube-api-access-9wj5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:27.880082 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.880001    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7498-139788215646944"]
Jul 27 20:18:27.880392 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.880380    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734a3c92-4634-4e79-a547-bc5aa0afe650" containerName="test-curl-7498-139788215646224"
Jul 27 20:18:27.880436 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.880394    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="734a3c92-4634-4e79-a547-bc5aa0afe650" containerName="test-curl-7498-139788215646224"
Jul 27 20:18:27.880478 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.880469    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="734a3c92-4634-4e79-a547-bc5aa0afe650" containerName="test-curl-7498-139788215646224"
Jul 27 20:18:27.883287 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.883270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646944"
Jul 27 20:18:27.887594 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.887562    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215646944"]
Jul 27 20:18:27.916038 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.916002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw798\" (UniqueName: \"kubernetes.io/projected/7665e10c-9edc-418d-9a4b-e1e2d67405f6-kube-api-access-vw798\") pod \"test-curl-7498-139788215646944\" (UID: \"7665e10c-9edc-418d-9a4b-e1e2d67405f6\") " pod="opendatahub/test-curl-7498-139788215646944"
Jul 27 20:18:27.916191 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:27.916056    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wj5j\" (UniqueName: \"kubernetes.io/projected/734a3c92-4634-4e79-a547-bc5aa0afe650-kube-api-access-9wj5j\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:18:28.017064 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.017015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw798\" (UniqueName: \"kubernetes.io/projected/7665e10c-9edc-418d-9a4b-e1e2d67405f6-kube-api-access-vw798\") pod \"test-curl-7498-139788215646944\" (UID: \"7665e10c-9edc-418d-9a4b-e1e2d67405f6\") " pod="opendatahub/test-curl-7498-139788215646944"
Jul 27 20:18:28.026296 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.026268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw798\" (UniqueName: \"kubernetes.io/projected/7665e10c-9edc-418d-9a4b-e1e2d67405f6-kube-api-access-vw798\") pod \"test-curl-7498-139788215646944\" (UID: \"7665e10c-9edc-418d-9a4b-e1e2d67405f6\") " pod="opendatahub/test-curl-7498-139788215646944"
Jul 27 20:18:28.195051 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.195017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646944"
Jul 27 20:18:28.335454 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.335429    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7498-139788215646944"]
Jul 27 20:18:28.337923 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:18:28.337888    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7665e10c_9edc_418d_9a4b_e1e2d67405f6.slice/crio-f862915ea4d7b9f2acd059c63d31603c18faf17bb3f013a6e7c37feef28a2d72 WatchSource:0}: Error finding container f862915ea4d7b9f2acd059c63d31603c18faf17bb3f013a6e7c37feef28a2d72: Status 404 returned error can't find the container with id f862915ea4d7b9f2acd059c63d31603c18faf17bb3f013a6e7c37feef28a2d72
Jul 27 20:18:28.581809 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.581724    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:28.581809 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.581756    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7687b529548e2d78841b1b39e96ba4db8490832e16065720bfc3d7bdd05a550"
Jul 27 20:18:28.590684 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.590644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215646944" event={"ID":"7665e10c-9edc-418d-9a4b-e1e2d67405f6","Type":"ContainerStarted","Data":"f862915ea4d7b9f2acd059c63d31603c18faf17bb3f013a6e7c37feef28a2d72"}
Jul 27 20:18:28.595650 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:18:28.595624    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7498-139788215646224\" is forbidden: User \"system:node:ip-10-0-131-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-166.ec2.internal' and this object" podUID="734a3c92-4634-4e79-a547-bc5aa0afe650" pod="opendatahub/test-curl-7498-139788215646224"
Jul 27 20:18:28.943275 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:28.943238    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="734a3c92-4634-4e79-a547-bc5aa0afe650" path="/var/lib/kubelet/pods/734a3c92-4634-4e79-a547-bc5aa0afe650/volumes"
Jul 27 20:18:29.598287 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:29.598254    2559 generic.go:356] "Generic (PLEG): container finished" podID="7665e10c-9edc-418d-9a4b-e1e2d67405f6" containerID="0939d542f5da7d22a08aba858d2b5f44cbf59c855956c30ecabf27625da92116" exitCode=0
Jul 27 20:18:29.598474 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:29.598298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7498-139788215646944" event={"ID":"7665e10c-9edc-418d-9a4b-e1e2d67405f6","Type":"ContainerDied","Data":"0939d542f5da7d22a08aba858d2b5f44cbf59c855956c30ecabf27625da92116"}
Jul 27 20:18:30.745182 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.745155    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646944"
Jul 27 20:18:30.764691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.764663    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7498-139788215646944_7665e10c-9edc-418d-9a4b-e1e2d67405f6/test-curl-7498-139788215646944/0.log"
Jul 27 20:18:30.787221 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.787188    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7498-139788215646944"]
Jul 27 20:18:30.788956 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.788932    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7498-139788215646944"]
Jul 27 20:18:30.836921 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.836891    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw798\" (UniqueName: \"kubernetes.io/projected/7665e10c-9edc-418d-9a4b-e1e2d67405f6-kube-api-access-vw798\") pod \"7665e10c-9edc-418d-9a4b-e1e2d67405f6\" (UID: \"7665e10c-9edc-418d-9a4b-e1e2d67405f6\") "
Jul 27 20:18:30.838929 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.838906    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7665e10c-9edc-418d-9a4b-e1e2d67405f6-kube-api-access-vw798" (OuterVolumeSpecName: "kube-api-access-vw798") pod "7665e10c-9edc-418d-9a4b-e1e2d67405f6" (UID: "7665e10c-9edc-418d-9a4b-e1e2d67405f6"). InnerVolumeSpecName "kube-api-access-vw798". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:18:30.937472 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.937442    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw798\" (UniqueName: \"kubernetes.io/projected/7665e10c-9edc-418d-9a4b-e1e2d67405f6-kube-api-access-vw798\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:18:30.942046 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:30.942020    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7665e10c-9edc-418d-9a4b-e1e2d67405f6" path="/var/lib/kubelet/pods/7665e10c-9edc-418d-9a4b-e1e2d67405f6/volumes"
Jul 27 20:18:31.609787 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:31.609755    2559 scope.go:117] "RemoveContainer" containerID="0939d542f5da7d22a08aba858d2b5f44cbf59c855956c30ecabf27625da92116"
Jul 27 20:18:31.609787 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:31.609779    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7498-139788215646944"
Jul 27 20:18:34.853544 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.853511    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"]
Jul 27 20:18:34.853970 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.853940    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7665e10c-9edc-418d-9a4b-e1e2d67405f6" containerName="test-curl-7498-139788215646944"
Jul 27 20:18:34.853970 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.853960    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7665e10c-9edc-418d-9a4b-e1e2d67405f6" containerName="test-curl-7498-139788215646944"
Jul 27 20:18:34.854100 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.854054    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7665e10c-9edc-418d-9a4b-e1e2d67405f6" containerName="test-curl-7498-139788215646944"
Jul 27 20:18:34.858806 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.858785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.861001 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.860980    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6c472a-openshift-default-dockercfg-rtfkz\""
Jul 27 20:18:34.869010 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.868989    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"]
Jul 27 20:18:34.875448 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-podinfo\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875548 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-data\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875548 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-credential-socket\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875668 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-certs\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875668 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f44pc\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-kube-api-access-f44pc\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875741 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875708    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istiod-ca-cert\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875776 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-envoy\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875818 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-token\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.875873 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.875832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-socket\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977343 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-socket\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977531 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-podinfo\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977531 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-data\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977531 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-credential-socket\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977800 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-certs\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977800 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f44pc\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-kube-api-access-f44pc\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977946 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-socket\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977946 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-data\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977946 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istiod-ca-cert\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977946 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-envoy\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.977946 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.977943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-token\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.978189 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.978073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-credential-socket\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.978346 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.978307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-certs\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.978485 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.978459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istiod-ca-cert\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.980538 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.980513    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-envoy\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.980681 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.980667    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-podinfo\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.985351 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.985329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-token\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:34.985482 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:34.985465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f44pc\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-kube-api-access-f44pc\") pod \"e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") " pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:35.170533 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.170439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:35.318341 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.318311    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"]
Jul 27 20:18:35.320039 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:18:35.320012    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53a4de3_586a_4cda_a1e4_a2b0063300ef.slice/crio-d0c367b40ab87d96d1ebf44cbb7d73aa44a48e255d346ad086440d1daec99796 WatchSource:0}: Error finding container d0c367b40ab87d96d1ebf44cbb7d73aa44a48e255d346ad086440d1daec99796: Status 404 returned error can't find the container with id d0c367b40ab87d96d1ebf44cbb7d73aa44a48e255d346ad086440d1daec99796
Jul 27 20:18:35.322540 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.322498    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:18:35.322623 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.322587    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:18:35.322669 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.322639    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:18:35.633786 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.633754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" event={"ID":"e53a4de3-586a-4cda-a1e4-a2b0063300ef","Type":"ContainerStarted","Data":"5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c"}
Jul 27 20:18:35.634047 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.633814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" event={"ID":"e53a4de3-586a-4cda-a1e4-a2b0063300ef","Type":"ContainerStarted","Data":"d0c367b40ab87d96d1ebf44cbb7d73aa44a48e255d346ad086440d1daec99796"}
Jul 27 20:18:35.653147 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:35.653096    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" podStartSLOduration=1.6530806340000002 podStartE2EDuration="1.653080634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:35.651385396 +0000 UTC m=+3175.346941491" watchObservedRunningTime="2026-07-27 20:18:35.653080634 +0000 UTC m=+3175.348636728"
Jul 27 20:18:36.170753 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:36.170716    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:36.175483 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:36.175461    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:36.639988 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:36.639959    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:36.640951 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:36.640928    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:43.963781 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:43.963728    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:18:52.195565 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.195004    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": read tcp 10.132.0.2:42936->10.132.0.96:15021: read: connection reset by peer" start-of-body=
Jul 27 20:18:52.195565 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.195085    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": read tcp 10.132.0.2:42936->10.132.0.96:15021: read: connection reset by peer"
Jul 27 20:18:52.723219 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.723186    2559 generic.go:356] "Generic (PLEG): container finished" podID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerID="5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c" exitCode=0
Jul 27 20:18:52.723401 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.723265    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" event={"ID":"e53a4de3-586a-4cda-a1e4-a2b0063300ef","Type":"ContainerDied","Data":"5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c"}
Jul 27 20:18:52.723865 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.723834    2559 scope.go:117] "RemoveContainer" containerID="5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c"
Jul 27 20:18:52.725006 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.724979    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:18:52.725076 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.725046    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:18:52.725117 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:52.725075    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:18:53.735012 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:53.734975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" event={"ID":"e53a4de3-586a-4cda-a1e4-a2b0063300ef","Type":"ContainerStarted","Data":"09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2"}
Jul 27 20:18:54.171002 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:54.170905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:54.171264 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:54.171238    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 27 20:18:54.171358 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:54.171297    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 27 20:18:55.171498 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:55.171462    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 27 20:18:55.171939 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:55.171526    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 27 20:18:56.171023 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:56.170990    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 27 20:18:56.171182 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:56.171044    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 27 20:18:57.171741 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:57.171701    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 27 20:18:57.172258 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:57.171766    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 27 20:18:58.175073 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:58.175044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:58.175525 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:58.175417    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:18:58.176022 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:18:58.176001    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:19:03.431136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.431099    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"]
Jul 27 20:19:03.435581 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.435551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.438128 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.438095    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-d4162b-openshift-default-dockercfg-qfjpz\""
Jul 27 20:19:03.446122 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.446095    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"]
Jul 27 20:19:03.568528 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd01759-a7f1-44e3-85cc-598520769099-istiod-ca-cert\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568731 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-socket\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568731 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpr5h\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-kube-api-access-dpr5h\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568731 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-envoy\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568731 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568713    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-certs\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568936 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-data\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568936 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd01759-a7f1-44e3-85cc-598520769099-istio-podinfo\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568936 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-istio-token\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.568936 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.568845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-credential-socket\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.669598 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-socket\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.669598 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpr5h\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-kube-api-access-dpr5h\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.669902 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-envoy\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.669902 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-certs\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.669902 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-data\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.669902 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd01759-a7f1-44e3-85cc-598520769099-istio-podinfo\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670159 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-istio-token\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670159 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.669975    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-credential-socket\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670159 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.670044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-socket\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670159 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.670062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-certs\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670159 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.670083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd01759-a7f1-44e3-85cc-598520769099-istiod-ca-cert\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670159 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.670095    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-data\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670443 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.670312    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-credential-socket\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.670670 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.670644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd01759-a7f1-44e3-85cc-598520769099-istiod-ca-cert\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.672048 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.672030    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-envoy\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.672384 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.672363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd01759-a7f1-44e3-85cc-598520769099-istio-podinfo\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.677253 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.677225    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-istio-token\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.677332 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.677300    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpr5h\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-kube-api-access-dpr5h\") pod \"e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") " pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.748512 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.748418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:03.912893 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.912846    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"]
Jul 27 20:19:03.914732 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:19:03.914701    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd01759_a7f1_44e3_85cc_598520769099.slice/crio-ea96d6baa1e502a67ec5650eb18487ba8545f3bb6530ee84e5d3c5faad8db3fc WatchSource:0}: Error finding container ea96d6baa1e502a67ec5650eb18487ba8545f3bb6530ee84e5d3c5faad8db3fc: Status 404 returned error can't find the container with id ea96d6baa1e502a67ec5650eb18487ba8545f3bb6530ee84e5d3c5faad8db3fc
Jul 27 20:19:03.917255 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.917211    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:19:03.917342 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.917306    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:19:03.917387 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:03.917350    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:19:04.792935 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:04.792897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" event={"ID":"8dd01759-a7f1-44e3-85cc-598520769099","Type":"ContainerStarted","Data":"c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8"}
Jul 27 20:19:04.793345 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:04.792956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" event={"ID":"8dd01759-a7f1-44e3-85cc-598520769099","Type":"ContainerStarted","Data":"ea96d6baa1e502a67ec5650eb18487ba8545f3bb6530ee84e5d3c5faad8db3fc"}
Jul 27 20:19:04.815329 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:04.815286    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" podStartSLOduration=1.815270637 podStartE2EDuration="1.815270637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:19:04.813287817 +0000 UTC m=+3204.508843936" watchObservedRunningTime="2026-07-27 20:19:04.815270637 +0000 UTC m=+3204.510826731"
Jul 27 20:19:05.749296 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:05.749245    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:05.754828 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:05.754801    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:05.799091 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:05.799064    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:05.800160 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:05.800141    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:16.061269 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:16.061231    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:19:24.897846 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:24.897812    2559 generic.go:356] "Generic (PLEG): container finished" podID="8dd01759-a7f1-44e3-85cc-598520769099" containerID="c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8" exitCode=0
Jul 27 20:19:24.898281 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:24.897884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" event={"ID":"8dd01759-a7f1-44e3-85cc-598520769099","Type":"ContainerDied","Data":"c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8"}
Jul 27 20:19:24.898327 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:24.898295    2559 scope.go:117] "RemoveContainer" containerID="c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8"
Jul 27 20:19:24.899434 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:24.899402    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:19:24.899527 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:24.899489    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:19:24.899527 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:24.899522    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:19:25.905907 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:25.905871    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" event={"ID":"8dd01759-a7f1-44e3-85cc-598520769099","Type":"ContainerStarted","Data":"34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3"}
Jul 27 20:19:26.748904 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:26.748846    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:26.749083 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:26.749052    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Jul 27 20:19:26.749132 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:26.749091    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" podUID="8dd01759-a7f1-44e3-85cc-598520769099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Jul 27 20:19:27.749879 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:27.749821    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Jul 27 20:19:27.750279 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:27.749907    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" podUID="8dd01759-a7f1-44e3-85cc-598520769099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Jul 27 20:19:28.749190 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:28.749157    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Jul 27 20:19:28.749373 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:28.749219    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" podUID="8dd01759-a7f1-44e3-85cc-598520769099" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Jul 27 20:19:29.752477 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:29.752444    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:29.752939 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:29.752876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:29.753646 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:29.753625    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:19:45.866402 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:19:45.866325    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:20:13.257938 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:13.257900    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:20:24.099343 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.099306    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"]
Jul 27 20:20:24.102518 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.102500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.104604 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.104584    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-d4c0c3-openshift-default-dockercfg-g7mwz\""
Jul 27 20:20:24.113779 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.113751    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"]
Jul 27 20:20:24.273379 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee52fe2c-a466-40bf-bf2f-983ce665e290-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273558 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-data\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273558 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-credential-socket\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273558 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273510    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-socket\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273558 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-podinfo\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273722 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xxnv\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-kube-api-access-5xxnv\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273722 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-token\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273722 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-certs\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.273722 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.273685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-envoy\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375070 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.374986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-socket\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375070 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-podinfo\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375070 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xxnv\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-kube-api-access-5xxnv\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375368 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-token\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375368 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-certs\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375368 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-envoy\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375368 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee52fe2c-a466-40bf-bf2f-983ce665e290-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375368 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-data\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375368 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-credential-socket\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375681 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-certs\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375681 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-socket\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375681 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-data\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.375972 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.375953    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-credential-socket\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.376103 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.376079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee52fe2c-a466-40bf-bf2f-983ce665e290-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.377553 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.377533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-envoy\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.377776 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.377759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-podinfo\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.382323 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.382301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-token\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.382527 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.382503    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xxnv\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-kube-api-access-5xxnv\") pod \"e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") " pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.415105 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.415069    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:24.558530 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.558500    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"]
Jul 27 20:20:24.560550 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:20:24.560519    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee52fe2c_a466_40bf_bf2f_983ce665e290.slice/crio-540949d6b2e2d0ad8c9a761e5babd83df15f18f92458a2ca452528a8b1392288 WatchSource:0}: Error finding container 540949d6b2e2d0ad8c9a761e5babd83df15f18f92458a2ca452528a8b1392288: Status 404 returned error can't find the container with id 540949d6b2e2d0ad8c9a761e5babd83df15f18f92458a2ca452528a8b1392288
Jul 27 20:20:24.562805 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.562770    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:20:24.562896 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.562838    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:20:24.562896 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:24.562888    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:20:25.238893 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:25.238838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" event={"ID":"ee52fe2c-a466-40bf-bf2f-983ce665e290","Type":"ContainerStarted","Data":"23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3"}
Jul 27 20:20:25.239286 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:25.238915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" event={"ID":"ee52fe2c-a466-40bf-bf2f-983ce665e290","Type":"ContainerStarted","Data":"540949d6b2e2d0ad8c9a761e5babd83df15f18f92458a2ca452528a8b1392288"}
Jul 27 20:20:25.259798 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:25.259745    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" podStartSLOduration=1.259731119 podStartE2EDuration="1.259731119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:20:25.257455611 +0000 UTC m=+3284.953011704" watchObservedRunningTime="2026-07-27 20:20:25.259731119 +0000 UTC m=+3284.955287212"
Jul 27 20:20:25.415566 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:25.415516    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:25.420947 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:25.420923    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:26.244204 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:26.244175    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:26.245091 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:26.245075    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:32.857428 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:32.857389    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:20:41.082017 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.081944    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:20:41.086877 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.086844    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:20:41.092591 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.092569    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:20:41.096696 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.096681    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qjf8q_ab06e64b-b71c-47e2-b5e9-85941805ae44/ovn-acl-logging/0.log"
Jul 27 20:20:41.245431 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.245397    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Jul 27 20:20:41.245602 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.245458    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Jul 27 20:20:41.332534 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.332500    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerID="23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3" exitCode=0
Jul 27 20:20:41.332702 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.332569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" event={"ID":"ee52fe2c-a466-40bf-bf2f-983ce665e290","Type":"ContainerDied","Data":"23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3"}
Jul 27 20:20:41.333013 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.332998    2559 scope.go:117] "RemoveContainer" containerID="23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3"
Jul 27 20:20:41.334163 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.334135    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:20:41.334234 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.334204    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:20:41.334279 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:41.334240    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 20:20:42.340631 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:42.340601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" event={"ID":"ee52fe2c-a466-40bf-bf2f-983ce665e290","Type":"ContainerStarted","Data":"d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d"}
Jul 27 20:20:42.416086 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:42.416019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:42.416797 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:42.416455    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Jul 27 20:20:42.416797 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:42.416520    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Jul 27 20:20:43.415779 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:43.415737    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Jul 27 20:20:43.416303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:43.415806    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Jul 27 20:20:44.415759 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:44.415719    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Jul 27 20:20:44.416262 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:44.416224    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Jul 27 20:20:45.416412 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:45.416366    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Jul 27 20:20:45.416929 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:45.416454    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Jul 27 20:20:46.419727 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:46.419695    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:46.420194 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:46.420117    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:20:46.420926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:20:46.420906    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:21:00.226508 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:00.226469    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:21:04.053765 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:04.053687    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"]
Jul 27 20:21:04.054166 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:04.053920    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy" containerID="cri-o://d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d" gracePeriod=30
Jul 27 20:21:09.312910 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.312885    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:21:09.348455 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348377    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee52fe2c-a466-40bf-bf2f-983ce665e290-istiod-ca-cert\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348455 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348412    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xxnv\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-kube-api-access-5xxnv\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348460    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-data\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348536    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-envoy\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348579    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-credential-socket\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348694 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348649    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-socket\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348957 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348729    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-token\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348957 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348767    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-podinfo\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348957 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348816    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-certs\") pod \"ee52fe2c-a466-40bf-bf2f-983ce665e290\" (UID: \"ee52fe2c-a466-40bf-bf2f-983ce665e290\") "
Jul 27 20:21:09.348957 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.348840    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee52fe2c-a466-40bf-bf2f-983ce665e290-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:21:09.349157 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.349033    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:09.349157 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.349087    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:09.349274 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.349255    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.349328 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.349273    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.349328 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.349288    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee52fe2c-a466-40bf-bf2f-983ce665e290-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.349328 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.349254    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:09.349328 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.349305    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:09.350920 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.350890    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-kube-api-access-5xxnv" (OuterVolumeSpecName: "kube-api-access-5xxnv") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "kube-api-access-5xxnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:09.351180 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.351157    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:21:09.351293 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.351221    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:21:09.351567 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.351549    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee52fe2c-a466-40bf-bf2f-983ce665e290" (UID: "ee52fe2c-a466-40bf-bf2f-983ce665e290"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:21:09.450303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.450261    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.450303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.450296    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.450303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.450308    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.450553 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.450321    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xxnv\" (UniqueName: \"kubernetes.io/projected/ee52fe2c-a466-40bf-bf2f-983ce665e290-kube-api-access-5xxnv\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.450553 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.450333    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.450553 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.450343    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee52fe2c-a466-40bf-bf2f-983ce665e290-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:21:09.498900 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.498840    2559 generic.go:356] "Generic (PLEG): container finished" podID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerID="d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d" exitCode=0
Jul 27 20:21:09.499083 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.498914    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"
Jul 27 20:21:09.499083 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.498908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" event={"ID":"ee52fe2c-a466-40bf-bf2f-983ce665e290","Type":"ContainerDied","Data":"d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d"}
Jul 27 20:21:09.499083 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.499064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj" event={"ID":"ee52fe2c-a466-40bf-bf2f-983ce665e290","Type":"ContainerDied","Data":"540949d6b2e2d0ad8c9a761e5babd83df15f18f92458a2ca452528a8b1392288"}
Jul 27 20:21:09.499250 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.499098    2559 scope.go:117] "RemoveContainer" containerID="d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d"
Jul 27 20:21:09.508804 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.508785    2559 scope.go:117] "RemoveContainer" containerID="23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3"
Jul 27 20:21:09.517049 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.517031    2559 scope.go:117] "RemoveContainer" containerID="d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d"
Jul 27 20:21:09.517293 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:21:09.517273    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d\": container with ID starting with d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d not found: ID does not exist" containerID="d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d"
Jul 27 20:21:09.517354 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.517301    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d"} err="failed to get container status \"d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d\": rpc error: code = NotFound desc = could not find container \"d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d\": container with ID starting with d2822561a4be86abdbc4620c6bc649bf559cc70a5d7dd2803396a7c414a9c14d not found: ID does not exist"
Jul 27 20:21:09.517354 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.517317    2559 scope.go:117] "RemoveContainer" containerID="23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3"
Jul 27 20:21:09.517540 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:21:09.517523    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3\": container with ID starting with 23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3 not found: ID does not exist" containerID="23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3"
Jul 27 20:21:09.517582 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.517545    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3"} err="failed to get container status \"23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3\": rpc error: code = NotFound desc = could not find container \"23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3\": container with ID starting with 23acdd5df7665452efa55de6adbd2083e27e642c15951d62eed9ca8e029b32b3 not found: ID does not exist"
Jul 27 20:21:09.520529 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.520503    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"]
Jul 27 20:21:09.523897 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:09.523875    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d4c0c3-openshift-default-9b6db7b58-vn4nj"]
Jul 27 20:21:10.942231 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:10.942199    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" path="/var/lib/kubelet/pods/ee52fe2c-a466-40bf-bf2f-983ce665e290/volumes"
Jul 27 20:21:23.556243 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:23.556211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:21:34.755317 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:21:34.755278    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:22:16.086306 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:16.086271    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"]
Jul 27 20:22:16.086878 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:16.086505    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy" containerID="cri-o://09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2" gracePeriod=30
Jul 27 20:22:21.347685 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.347626    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:22:21.358102 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-certs\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358238 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358111    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-envoy\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358238 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358149    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-socket\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358238 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358168    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-token\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358238 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358192    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istiod-ca-cert\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358238 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358226    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-data\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358502 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358246    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f44pc\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-kube-api-access-f44pc\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358502 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358280    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-credential-socket\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358502 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358315    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-podinfo\") pod \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\" (UID: \"e53a4de3-586a-4cda-a1e4-a2b0063300ef\") "
Jul 27 20:22:21.358651 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358529    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:21.358714 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358657    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.358714 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358692    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:22:21.358901 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:21.358991 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.358945    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:21.359298 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.359269    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:21.360923 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.360874    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:21.360923 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.360905    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:22:21.361107 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.361088    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-kube-api-access-f44pc" (OuterVolumeSpecName: "kube-api-access-f44pc") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "kube-api-access-f44pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:22:21.361107 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.361099    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e53a4de3-586a-4cda-a1e4-a2b0063300ef" (UID: "e53a4de3-586a-4cda-a1e4-a2b0063300ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:22:21.459197 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459166    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.459197 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459193    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.459197 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459202    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.459197 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459210    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.459476 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459219    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f44pc\" (UniqueName: \"kubernetes.io/projected/e53a4de3-586a-4cda-a1e4-a2b0063300ef-kube-api-access-f44pc\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.459476 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459227    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.459476 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459237    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a4de3-586a-4cda-a1e4-a2b0063300ef-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.459476 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.459245    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a4de3-586a-4cda-a1e4-a2b0063300ef-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:21.884920 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.884885    2559 generic.go:356] "Generic (PLEG): container finished" podID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerID="09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2" exitCode=0
Jul 27 20:22:21.885130 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.884944    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"
Jul 27 20:22:21.885130 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.884968    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" event={"ID":"e53a4de3-586a-4cda-a1e4-a2b0063300ef","Type":"ContainerDied","Data":"09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2"}
Jul 27 20:22:21.885130 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.885025    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj" event={"ID":"e53a4de3-586a-4cda-a1e4-a2b0063300ef","Type":"ContainerDied","Data":"d0c367b40ab87d96d1ebf44cbb7d73aa44a48e255d346ad086440d1daec99796"}
Jul 27 20:22:21.885130 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.885047    2559 scope.go:117] "RemoveContainer" containerID="09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2"
Jul 27 20:22:21.894950 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.894932    2559 scope.go:117] "RemoveContainer" containerID="5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c"
Jul 27 20:22:21.903556 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.903535    2559 scope.go:117] "RemoveContainer" containerID="09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2"
Jul 27 20:22:21.903817 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:22:21.903793    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2\": container with ID starting with 09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2 not found: ID does not exist" containerID="09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2"
Jul 27 20:22:21.903889 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.903831    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2"} err="failed to get container status \"09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2\": rpc error: code = NotFound desc = could not find container \"09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2\": container with ID starting with 09f1642561086c22c0b52518c2471fe9f39eb3a6e9e8feaebef1c6dc246561c2 not found: ID does not exist"
Jul 27 20:22:21.903889 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.903865    2559 scope.go:117] "RemoveContainer" containerID="5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c"
Jul 27 20:22:21.904201 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:22:21.904179    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c\": container with ID starting with 5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c not found: ID does not exist" containerID="5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c"
Jul 27 20:22:21.904292 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.904211    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c"} err="failed to get container status \"5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c\": rpc error: code = NotFound desc = could not find container \"5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c\": container with ID starting with 5a7bbcee8aba169289f12d8d54248e49fc11f948dfaa18dc289b7ff0a8117d1c not found: ID does not exist"
Jul 27 20:22:21.906487 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.906464    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"]
Jul 27 20:22:21.911335 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:21.911313    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6c472a-openshift-default-5579cfccc6-5pwxj"]
Jul 27 20:22:22.942476 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:22.942442    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" path="/var/lib/kubelet/pods/e53a4de3-586a-4cda-a1e4-a2b0063300ef/volumes"
Jul 27 20:22:30.065420 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:30.065383    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:22:38.037863 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:38.037776    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"]
Jul 27 20:22:38.038259 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:38.038011    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" podUID="8dd01759-a7f1-44e3-85cc-598520769099" containerName="istio-proxy" containerID="cri-o://34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3" gracePeriod=30
Jul 27 20:22:43.307445 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.307380    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:22:43.360654 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360621    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-certs\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.360825 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd01759-a7f1-44e3-85cc-598520769099-istio-podinfo\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.360825 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360684    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-socket\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.360825 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-envoy\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.360825 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360781    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-istio-token\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.361068 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360834    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpr5h\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-kube-api-access-dpr5h\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.361068 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360875    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-credential-socket\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.361068 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360913    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-data\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.361068 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.360958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd01759-a7f1-44e3-85cc-598520769099-istiod-ca-cert\") pod \"8dd01759-a7f1-44e3-85cc-598520769099\" (UID: \"8dd01759-a7f1-44e3-85cc-598520769099\") "
Jul 27 20:22:43.361068 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361018    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:43.361068 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361029    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:43.361386 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:43.361386 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361338    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.361386 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361353    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.361386 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361362    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.361606 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361404    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd01759-a7f1-44e3-85cc-598520769099-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:22:43.361944 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.361922    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-data" (OuterVolumeSpecName: "istio-data") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:43.362952 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.362918    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:22:43.363381 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.363357    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-istio-token" (OuterVolumeSpecName: "istio-token") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:22:43.363470 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.363371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-kube-api-access-dpr5h" (OuterVolumeSpecName: "kube-api-access-dpr5h") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "kube-api-access-dpr5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:22:43.363470 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.363382    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8dd01759-a7f1-44e3-85cc-598520769099-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8dd01759-a7f1-44e3-85cc-598520769099" (UID: "8dd01759-a7f1-44e3-85cc-598520769099"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:22:43.462131 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.462091    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.462131 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.462123    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpr5h\" (UniqueName: \"kubernetes.io/projected/8dd01759-a7f1-44e3-85cc-598520769099-kube-api-access-dpr5h\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.462131 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.462133    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.462131 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.462142    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dd01759-a7f1-44e3-85cc-598520769099-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.462403 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.462150    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dd01759-a7f1-44e3-85cc-598520769099-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:43.462403 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:43.462159    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dd01759-a7f1-44e3-85cc-598520769099-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:22:44.001727 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.001690    2559 generic.go:356] "Generic (PLEG): container finished" podID="8dd01759-a7f1-44e3-85cc-598520769099" containerID="34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3" exitCode=0
Jul 27 20:22:44.001727 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.001732    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"
Jul 27 20:22:44.002021 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.001750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" event={"ID":"8dd01759-a7f1-44e3-85cc-598520769099","Type":"ContainerDied","Data":"34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3"}
Jul 27 20:22:44.002021 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.001802    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v" event={"ID":"8dd01759-a7f1-44e3-85cc-598520769099","Type":"ContainerDied","Data":"ea96d6baa1e502a67ec5650eb18487ba8545f3bb6530ee84e5d3c5faad8db3fc"}
Jul 27 20:22:44.002021 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.001831    2559 scope.go:117] "RemoveContainer" containerID="34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3"
Jul 27 20:22:44.011376 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.011359    2559 scope.go:117] "RemoveContainer" containerID="c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8"
Jul 27 20:22:44.019674 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.019656    2559 scope.go:117] "RemoveContainer" containerID="34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3"
Jul 27 20:22:44.019943 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:22:44.019923    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3\": container with ID starting with 34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3 not found: ID does not exist" containerID="34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3"
Jul 27 20:22:44.020000 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.019951    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3"} err="failed to get container status \"34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3\": rpc error: code = NotFound desc = could not find container \"34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3\": container with ID starting with 34a713dde9ac85293677270990a3d395c5393ff64e497f12b2c0f0426b4f74f3 not found: ID does not exist"
Jul 27 20:22:44.020000 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.019969    2559 scope.go:117] "RemoveContainer" containerID="c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8"
Jul 27 20:22:44.020210 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:22:44.020188    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8\": container with ID starting with c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8 not found: ID does not exist" containerID="c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8"
Jul 27 20:22:44.020255 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.020218    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8"} err="failed to get container status \"c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8\": rpc error: code = NotFound desc = could not find container \"c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8\": container with ID starting with c08b4aa927b1ed59c1d2105c79477fa208cc9d254f0bfa984f5571a0acd576c8 not found: ID does not exist"
Jul 27 20:22:44.023218 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.023144    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"]
Jul 27 20:22:44.025040 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.025017    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4162b-openshift-default-6f99588978-p9n5v"]
Jul 27 20:22:44.942087 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:44.942052    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dd01759-a7f1-44e3-85cc-598520769099" path="/var/lib/kubelet/pods/8dd01759-a7f1-44e3-85cc-598520769099/volumes"
Jul 27 20:22:52.056303 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:22:52.056269    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:23:00.027060 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:00.027027    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"]
Jul 27 20:23:00.027570 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:00.027271    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy" containerID="cri-o://2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc" gracePeriod=30
Jul 27 20:23:05.295026 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.294969    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:23:05.472363 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472327    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-envoy\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472557 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472382    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f785cead-9e86-407c-b182-f9e0938bcd53-istio-podinfo\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472557 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472404    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f785cead-9e86-407c-b182-f9e0938bcd53-istiod-ca-cert\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472557 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472456    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-istio-token\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472557 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472482    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-credential-socket\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472564    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-certs\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472613    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb26n\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-kube-api-access-wb26n\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472639    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-socket\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472692    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-data\") pod \"f785cead-9e86-407c-b182-f9e0938bcd53\" (UID: \"f785cead-9e86-407c-b182-f9e0938bcd53\") "
Jul 27 20:23:05.472789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472767    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:05.473072 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472831    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:05.473072 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472887    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f785cead-9e86-407c-b182-f9e0938bcd53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:23:05.473072 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.472984    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:05.473232 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.473137    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.473232 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.473157    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.473232 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.473171    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f785cead-9e86-407c-b182-f9e0938bcd53-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.473232 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.473187    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.473772 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.473745    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-data" (OuterVolumeSpecName: "istio-data") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:05.474773 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.474740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-istio-token" (OuterVolumeSpecName: "istio-token") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:23:05.474908 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.474790    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-kube-api-access-wb26n" (OuterVolumeSpecName: "kube-api-access-wb26n") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "kube-api-access-wb26n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:23:05.474908 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.474825    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f785cead-9e86-407c-b182-f9e0938bcd53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:23:05.475004 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.474948    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f785cead-9e86-407c-b182-f9e0938bcd53" (UID: "f785cead-9e86-407c-b182-f9e0938bcd53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:05.574100 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.574017    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f785cead-9e86-407c-b182-f9e0938bcd53-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.574100 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.574044    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.574100 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.574053    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb26n\" (UniqueName: \"kubernetes.io/projected/f785cead-9e86-407c-b182-f9e0938bcd53-kube-api-access-wb26n\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.574100 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.574062    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:05.574100 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:05.574071    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f785cead-9e86-407c-b182-f9e0938bcd53-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:06.118213 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.118178    2559 generic.go:356] "Generic (PLEG): container finished" podID="f785cead-9e86-407c-b182-f9e0938bcd53" containerID="2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc" exitCode=0
Jul 27 20:23:06.118387 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.118226    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"
Jul 27 20:23:06.118387 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.118270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" event={"ID":"f785cead-9e86-407c-b182-f9e0938bcd53","Type":"ContainerDied","Data":"2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc"}
Jul 27 20:23:06.118387 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.118328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb" event={"ID":"f785cead-9e86-407c-b182-f9e0938bcd53","Type":"ContainerDied","Data":"d0320882ee28896767437b660f354daa6d285d1c7c7222dc09c5673ebe283d6b"}
Jul 27 20:23:06.118387 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.118354    2559 scope.go:117] "RemoveContainer" containerID="2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc"
Jul 27 20:23:06.127603 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.127586    2559 scope.go:117] "RemoveContainer" containerID="48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795"
Jul 27 20:23:06.135416 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.135398    2559 scope.go:117] "RemoveContainer" containerID="2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc"
Jul 27 20:23:06.135657 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:23:06.135637    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc\": container with ID starting with 2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc not found: ID does not exist" containerID="2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc"
Jul 27 20:23:06.135706 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.135666    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc"} err="failed to get container status \"2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc\": rpc error: code = NotFound desc = could not find container \"2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc\": container with ID starting with 2af6544fccf8d596e62b8109ffa544b8cd1bb4dcac1ab3673a231b233f334abc not found: ID does not exist"
Jul 27 20:23:06.135706 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.135684    2559 scope.go:117] "RemoveContainer" containerID="48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795"
Jul 27 20:23:06.135931 ip-10-0-131-166 kubenswrapper[2559]: E0727 20:23:06.135913    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795\": container with ID starting with 48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795 not found: ID does not exist" containerID="48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795"
Jul 27 20:23:06.135992 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.135939    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795"} err="failed to get container status \"48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795\": rpc error: code = NotFound desc = could not find container \"48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795\": container with ID starting with 48162dd54c41e973e41f241d75b18cb514f8ade6e0671ec14e8fd0b7e7456795 not found: ID does not exist"
Jul 27 20:23:06.138930 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.138910    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"]
Jul 27 20:23:06.140566 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.140547    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-97e28d-openshift-default-6996585576-wb7fb"]
Jul 27 20:23:06.941461 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:06.941428    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" path="/var/lib/kubelet/pods/f785cead-9e86-407c-b182-f9e0938bcd53/volumes"
Jul 27 20:23:13.367902 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:13.367863    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z7r7v"]
Jul 27 20:23:22.017681 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:22.017646    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"]
Jul 27 20:23:22.018136 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:22.017842    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy" containerID="cri-o://fd140750a11025a6c50e572be58bcf6a746d4b1b547ce8e72c41618283163711" gracePeriod=30
Jul 27 20:23:22.816584 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:22.816546    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869696d786-tz9q2_7969bd6f-be19-4674-b55c-81e2d6aaafac/authorino/0.log"
Jul 27 20:23:27.234962 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.234928    2559 generic.go:356] "Generic (PLEG): container finished" podID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerID="fd140750a11025a6c50e572be58bcf6a746d4b1b547ce8e72c41618283163711" exitCode=0
Jul 27 20:23:27.235379 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.234996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" event={"ID":"b82f9bad-1f75-4f07-90d4-6f203f435e57","Type":"ContainerDied","Data":"fd140750a11025a6c50e572be58bcf6a746d4b1b547ce8e72c41618283163711"}
Jul 27 20:23:27.235379 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.235064    2559 scope.go:117] "RemoveContainer" containerID="b81c6bff8da22b3cb83965b231e171a713108e8d916138926f2cf02b36705980"
Jul 27 20:23:27.273218 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.273190    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:23:27.373901 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.373787    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-credential-socket\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.373901 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.373823    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-certs\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.373901 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.373887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b82f9bad-1f75-4f07-90d4-6f203f435e57-istiod-ca-cert\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.374170 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.373921    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-podinfo\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.374170 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.373964    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-envoy\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.374170 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.373992    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cmkf\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-kube-api-access-2cmkf\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.374170 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374028    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-token\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.374170 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374069    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-data\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.374170 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:27.374170 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374147    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-socket\") pod \"b82f9bad-1f75-4f07-90d4-6f203f435e57\" (UID: \"b82f9bad-1f75-4f07-90d4-6f203f435e57\") "
Jul 27 20:23:27.374545 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374234    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:27.374545 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374331    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82f9bad-1f75-4f07-90d4-6f203f435e57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:23:27.374545 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374503    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:27.374709 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374624    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.374709 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374645    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-credential-socket\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.374709 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374660    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-workload-certs\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.374709 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.374674    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b82f9bad-1f75-4f07-90d4-6f203f435e57-istiod-ca-cert\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.375222 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.375194    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-data" (OuterVolumeSpecName: "istio-data") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:27.376357 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.376327    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:23:27.376484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.376371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-token" (OuterVolumeSpecName: "istio-token") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:23:27.376484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.376409    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-kube-api-access-2cmkf" (OuterVolumeSpecName: "kube-api-access-2cmkf") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "kube-api-access-2cmkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:23:27.376602 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.376504    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b82f9bad-1f75-4f07-90d4-6f203f435e57" (UID: "b82f9bad-1f75-4f07-90d4-6f203f435e57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:23:27.476054 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.476023    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-token\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.476054 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.476049    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-data\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.476054 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.476059    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-podinfo\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.476313 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.476067    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b82f9bad-1f75-4f07-90d4-6f203f435e57-istio-envoy\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:27.476313 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:27.476076    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cmkf\" (UniqueName: \"kubernetes.io/projected/b82f9bad-1f75-4f07-90d4-6f203f435e57-kube-api-access-2cmkf\") on node \"ip-10-0-131-166.ec2.internal\" DevicePath \"\""
Jul 27 20:23:28.243034 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.243008    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"
Jul 27 20:23:28.243448 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.243054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf" event={"ID":"b82f9bad-1f75-4f07-90d4-6f203f435e57","Type":"ContainerDied","Data":"8f4426143975d67a7d64eab510597839f69dff2bc82203ccdb3fe72fd6095971"}
Jul 27 20:23:28.243448 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.243110    2559 scope.go:117] "RemoveContainer" containerID="fd140750a11025a6c50e572be58bcf6a746d4b1b547ce8e72c41618283163711"
Jul 27 20:23:28.249710 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.249680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lfhc5_00d079e9-78ff-4565-9812-74771b83966b/manager/0.log"
Jul 27 20:23:28.264553 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.264524    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"]
Jul 27 20:23:28.270310 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.270287    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e837b8-openshift-default-6ffc9979cb-h7bgf"]
Jul 27 20:23:28.643811 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.643725    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pzrqd_854ca60e-d0b6-4c3b-a2f5-41181dec5241/server/0.log"
Jul 27 20:23:28.773421 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.773385    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kq5nd_4f0ccd3c-cc83-4127-998c-22e11cd64c7c/manager/0.log"
Jul 27 20:23:28.942347 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:28.942313    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" path="/var/lib/kubelet/pods/b82f9bad-1f75-4f07-90d4-6f203f435e57/volumes"
Jul 27 20:23:29.145011 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:29.144986    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-zt4bf_b9fa83b1-eb0e-479e-a9de-77f5fbeec46c/copy-manifests/0.log"
Jul 27 20:23:29.164278 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:29.164249    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-zt4bf_b9fa83b1-eb0e-479e-a9de-77f5fbeec46c/manager/0.log"
Jul 27 20:23:31.198067 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:31.197978    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869696d786-tz9q2_7969bd6f-be19-4674-b55c-81e2d6aaafac/authorino/0.log"
Jul 27 20:23:31.310411 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:31.310372    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5msfs_f8a1ee52-34b7-477b-b655-f924e48813f5/manager/0.log"
Jul 27 20:23:31.418006 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:31.417978    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vtnl2_560d86be-48f3-4097-8410-0f8b3f77aeeb/manager/0.log"
Jul 27 20:23:31.524465 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:31.524386    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6ht5d_81501b35-ed01-426c-ac9d-a871032d348e/kuadrant-console-plugin/0.log"
Jul 27 20:23:31.641277 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:31.641245    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fpb2q_1acd54de-6dd2-4071-aed6-fa5ab839ee7e/registry-server/0.log"
Jul 27 20:23:31.766865 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:31.766829    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mkgt6_dca21add-0cbf-409b-aa3b-3a101bcae3b8/manager/0.log"
Jul 27 20:23:31.884819 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:31.884737    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z7r7v_a1ad2cc0-f4fa-4638-89f5-a349d33b547c/limitador/0.log"
Jul 27 20:23:32.376484 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:32.376457    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp_04f0ebea-ef00-4298-acf9-cbcede6f2f10/istio-proxy/0.log"
Jul 27 20:23:32.717771 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:32.717742    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766b79c75b-mfcll_83eae4a6-489b-489a-9f2a-e76ccb890f6f/kube-auth-proxy/0.log"
Jul 27 20:23:32.842624 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:32.842583    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6qhzj_49151180-351a-4a01-a1c7-98335af6a6db/istio-proxy/1.log"
Jul 27 20:23:33.233001 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:33.232969    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648c8c87b9-rl85h_3a954648-6bb0-4672-817b-bfcb20c925db/router/0.log"
Jul 27 20:23:33.934564 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:33.934536    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4vdpc_c746f3e6-0e46-4b39-a95e-30651e2b262f/main/0.log"
Jul 27 20:23:42.919711 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:42.919675    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x2hh9_855ba6bc-d302-4d1d-b728-e39baf9c6393/global-pull-secret-syncer/0.log"
Jul 27 20:23:43.051051 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:43.051024    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r9vrm_139e1d59-13a4-4234-8dba-986ab727ef52/konnectivity-agent/0.log"
Jul 27 20:23:43.074246 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:43.074219    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-166.ec2.internal_ef1a0ca089fb19d21b89d75ed9181952/haproxy/0.log"
Jul 27 20:23:48.526077 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:48.526042    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869696d786-tz9q2_7969bd6f-be19-4674-b55c-81e2d6aaafac/authorino/0.log"
Jul 27 20:23:48.575836 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:48.575803    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5msfs_f8a1ee52-34b7-477b-b655-f924e48813f5/manager/0.log"
Jul 27 20:23:48.600125 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:48.600099    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vtnl2_560d86be-48f3-4097-8410-0f8b3f77aeeb/manager/0.log"
Jul 27 20:23:48.624510 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:48.624486    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6ht5d_81501b35-ed01-426c-ac9d-a871032d348e/kuadrant-console-plugin/0.log"
Jul 27 20:23:48.683928 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:48.683889    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fpb2q_1acd54de-6dd2-4071-aed6-fa5ab839ee7e/registry-server/0.log"
Jul 27 20:23:48.889493 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:48.889385    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-mkgt6_dca21add-0cbf-409b-aa3b-3a101bcae3b8/manager/0.log"
Jul 27 20:23:48.911464 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:48.911439    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z7r7v_a1ad2cc0-f4fa-4638-89f5-a349d33b547c/limitador/0.log"
Jul 27 20:23:50.856211 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:50.856176    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-mmxrs_36a1b7d0-2ff0-499f-a375-5eca85ae7b3c/cluster-monitoring-operator/0.log"
Jul 27 20:23:51.100457 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:51.100414    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8w7d2_165e87ff-6b19-42ea-a69e-c0e5dd4e88c0/node-exporter/0.log"
Jul 27 20:23:51.118904 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:51.118813    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8w7d2_165e87ff-6b19-42ea-a69e-c0e5dd4e88c0/kube-rbac-proxy/0.log"
Jul 27 20:23:51.144298 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:51.144269    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8w7d2_165e87ff-6b19-42ea-a69e-c0e5dd4e88c0/init-textfile/0.log"
Jul 27 20:23:52.909480 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:52.909444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-tgfb5_03221ef7-ec98-4d51-8ed9-9564a1ae597b/networking-console-plugin/0.log"
Jul 27 20:23:53.145304 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145268    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"]
Jul 27 20:23:53.145641 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145628    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy"
Jul 27 20:23:53.145691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145642    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy"
Jul 27 20:23:53.145691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145650    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy"
Jul 27 20:23:53.145691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145656    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy"
Jul 27 20:23:53.145691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145671    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy"
Jul 27 20:23:53.145691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145676    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy"
Jul 27 20:23:53.145691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145683    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy"
Jul 27 20:23:53.145691 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145688    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145697    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dd01759-a7f1-44e3-85cc-598520769099" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145702    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dd01759-a7f1-44e3-85cc-598520769099" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145711    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145717    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145723    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145728    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145739    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145744    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145802    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dd01759-a7f1-44e3-85cc-598520769099" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145808    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145813    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82f9bad-1f75-4f07-90d4-6f203f435e57" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145819    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145825    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145832    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53a4de3-586a-4cda-a1e4-a2b0063300ef" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145836    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f785cead-9e86-407c-b182-f9e0938bcd53" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145843    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy"
Jul 27 20:23:53.145926 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.145862    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee52fe2c-a466-40bf-bf2f-983ce665e290" containerName="istio-proxy"
Jul 27 20:23:53.150789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.150768    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.153946 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.153925    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8ngh2\"/\"default-dockercfg-gkqfh\""
Jul 27 20:23:53.154090 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.153948    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ngh2\"/\"kube-root-ca.crt\""
Jul 27 20:23:53.154825 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.154805    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ngh2\"/\"openshift-service-ca.crt\""
Jul 27 20:23:53.158736 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.158717    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"]
Jul 27 20:23:53.210461 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.210430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-lib-modules\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.210655 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.210479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-sys\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.210655 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.210612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rls77\" (UniqueName: \"kubernetes.io/projected/c952e7d4-3b2e-4411-af6d-5f692fe54a39-kube-api-access-rls77\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.210740 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.210652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-proc\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.210740 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.210686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-podres\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.311905 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.311847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-sys\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312085 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.311954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rls77\" (UniqueName: \"kubernetes.io/projected/c952e7d4-3b2e-4411-af6d-5f692fe54a39-kube-api-access-rls77\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312085 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.311963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-sys\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312085 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.311977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-proc\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312085 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.312023    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-proc\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312085 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.312022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-podres\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312304 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.312114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-podres\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312304 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.312116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-lib-modules\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.312304 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.312198    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c952e7d4-3b2e-4411-af6d-5f692fe54a39-lib-modules\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.319722 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.319690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rls77\" (UniqueName: \"kubernetes.io/projected/c952e7d4-3b2e-4411-af6d-5f692fe54a39-kube-api-access-rls77\") pod \"perf-node-gather-daemonset-688fd\" (UID: \"c952e7d4-3b2e-4411-af6d-5f692fe54a39\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.462247 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.462148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:53.560896 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.560826    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/1.log"
Jul 27 20:23:53.573734 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.573695    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-r4gfr_a2b78ebb-f09f-4caf-88d7-3c37b2276539/console-operator/2.log"
Jul 27 20:23:53.599597 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:53.599574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"]
Jul 27 20:23:53.601713 ip-10-0-131-166 kubenswrapper[2559]: W0727 20:23:53.601684    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc952e7d4_3b2e_4411_af6d_5f692fe54a39.slice/crio-147243e93fc43f0e5fd5b74bad2888d6dad4baeb7709e5fa3bd21ae7706ddcf6 WatchSource:0}: Error finding container 147243e93fc43f0e5fd5b74bad2888d6dad4baeb7709e5fa3bd21ae7706ddcf6: Status 404 returned error can't find the container with id 147243e93fc43f0e5fd5b74bad2888d6dad4baeb7709e5fa3bd21ae7706ddcf6
Jul 27 20:23:54.370127 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:54.370097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd" event={"ID":"c952e7d4-3b2e-4411-af6d-5f692fe54a39","Type":"ContainerStarted","Data":"979f576a6852e2e29aede840f2b921ac139d807a559a482de53ebac261c4cbd4"}
Jul 27 20:23:54.370532 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:54.370149    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd" event={"ID":"c952e7d4-3b2e-4411-af6d-5f692fe54a39","Type":"ContainerStarted","Data":"147243e93fc43f0e5fd5b74bad2888d6dad4baeb7709e5fa3bd21ae7706ddcf6"}
Jul 27 20:23:54.370532 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:54.370192    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:23:54.386470 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:54.386424    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd" podStartSLOduration=1.386409942 podStartE2EDuration="1.386409942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:23:54.384392831 +0000 UTC m=+3494.079948939" watchObservedRunningTime="2026-07-27 20:23:54.386409942 +0000 UTC m=+3494.081966035"
Jul 27 20:23:54.760110 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:54.760079    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-v22x8_0a8a7150-5c04-48c1-be16-9ea34bc9d937/volume-data-source-validator/0.log"
Jul 27 20:23:55.790273 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:55.790244    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5b2kq_f25992a9-9aaa-4bd9-aa0e-83c123afc97c/dns/0.log"
Jul 27 20:23:55.813550 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:55.813523    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5b2kq_f25992a9-9aaa-4bd9-aa0e-83c123afc97c/kube-rbac-proxy/0.log"
Jul 27 20:23:55.933662 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:55.933630    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnd5h_b1423591-5924-49ef-aa8f-397afa5ff9ac/dns-node-resolver/0.log"
Jul 27 20:23:56.654230 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:56.654171    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vfx74_935c5a73-81d4-4319-90f2-038e4f695dd9/node-ca/0.log"
Jul 27 20:23:57.587074 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:57.587041    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp_04f0ebea-ef00-4298-acf9-cbcede6f2f10/istio-proxy/0.log"
Jul 27 20:23:57.774813 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:57.774784    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766b79c75b-mfcll_83eae4a6-489b-489a-9f2a-e76ccb890f6f/kube-auth-proxy/0.log"
Jul 27 20:23:57.804676 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:57.804650    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6qhzj_49151180-351a-4a01-a1c7-98335af6a6db/istio-proxy/0.log"
Jul 27 20:23:57.855450 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:57.855363    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6qhzj_49151180-351a-4a01-a1c7-98335af6a6db/istio-proxy/1.log"
Jul 27 20:23:57.941786 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:57.941761    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648c8c87b9-rl85h_3a954648-6bb0-4672-817b-bfcb20c925db/router/0.log"
Jul 27 20:23:58.718796 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:58.718770    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c8ldc_f18b87cf-93b3-4ba6-8260-2efcfee5be08/serve-healthcheck-canary/0.log"
Jul 27 20:23:59.256528 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:59.256500    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-vcgvv_d0a9cc75-3c38-4758-9674-64a5e4ef0612/insights-operator/1.log"
Jul 27 20:23:59.259995 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:59.259972    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-vcgvv_d0a9cc75-3c38-4758-9674-64a5e4ef0612/insights-operator/0.log"
Jul 27 20:23:59.282429 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:59.282404    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b7zp7_976dd98b-aaf5-42b5-b150-934ad4dda614/kube-rbac-proxy/0.log"
Jul 27 20:23:59.305263 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:59.305242    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b7zp7_976dd98b-aaf5-42b5-b150-934ad4dda614/exporter/0.log"
Jul 27 20:23:59.329107 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:23:59.329072    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b7zp7_976dd98b-aaf5-42b5-b150-934ad4dda614/extractor/0.log"
Jul 27 20:24:00.387789 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:00.387763    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-688fd"
Jul 27 20:24:01.593393 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:01.593361    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lfhc5_00d079e9-78ff-4565-9812-74771b83966b/manager/0.log"
Jul 27 20:24:02.100313 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:02.100284    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pzrqd_854ca60e-d0b6-4c3b-a2f5-41181dec5241/server/0.log"
Jul 27 20:24:02.216791 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:02.216746    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kq5nd_4f0ccd3c-cc83-4127-998c-22e11cd64c7c/manager/0.log"
Jul 27 20:24:02.468232 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:02.468203    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-zt4bf_b9fa83b1-eb0e-479e-a9de-77f5fbeec46c/manager/0.log"
Jul 27 20:24:02.489955 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:02.489925    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-zt4bf_b9fa83b1-eb0e-479e-a9de-77f5fbeec46c/copy-manifests/0.log"
Jul 27 20:24:03.512937 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:03.512846    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp_04f0ebea-ef00-4298-acf9-cbcede6f2f10/istio-proxy/0.log"
Jul 27 20:24:03.677829 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:03.677796    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766b79c75b-mfcll_83eae4a6-489b-489a-9f2a-e76ccb890f6f/kube-auth-proxy/0.log"
Jul 27 20:24:03.697085 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:03.697042    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6qhzj_49151180-351a-4a01-a1c7-98335af6a6db/istio-proxy/0.log"
Jul 27 20:24:03.746304 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:03.746270    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6qhzj_49151180-351a-4a01-a1c7-98335af6a6db/istio-proxy/1.log"
Jul 27 20:24:03.810551 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:03.810467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648c8c87b9-rl85h_3a954648-6bb0-4672-817b-bfcb20c925db/router/0.log"
Jul 27 20:24:05.177595 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:05.177559    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zn8mp_04f0ebea-ef00-4298-acf9-cbcede6f2f10/istio-proxy/0.log"
Jul 27 20:24:05.349496 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:05.349466    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766b79c75b-mfcll_83eae4a6-489b-489a-9f2a-e76ccb890f6f/kube-auth-proxy/0.log"
Jul 27 20:24:05.374838 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:05.374809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6qhzj_49151180-351a-4a01-a1c7-98335af6a6db/istio-proxy/0.log"
Jul 27 20:24:05.426967 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:05.426937    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6qhzj_49151180-351a-4a01-a1c7-98335af6a6db/istio-proxy/1.log"
Jul 27 20:24:05.491249 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:05.491168    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-648c8c87b9-rl85h_3a954648-6bb0-4672-817b-bfcb20c925db/router/0.log"
Jul 27 20:24:09.058911 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:09.058881    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26_f9094e27-933d-4f5e-ba44-6ddc0d76a6f4/kube-storage-version-migrator-operator/1.log"
Jul 27 20:24:09.060636 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:09.060613    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-9tb26_f9094e27-933d-4f5e-ba44-6ddc0d76a6f4/kube-storage-version-migrator-operator/0.log"
Jul 27 20:24:10.051500 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.051467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9q9hc_5d4b3e91-7b1c-4803-9c39-aedc20ed3303/kube-multus/0.log"
Jul 27 20:24:10.074989 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.074964    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/kube-multus-additional-cni-plugins/0.log"
Jul 27 20:24:10.096766 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.096736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/egress-router-binary-copy/0.log"
Jul 27 20:24:10.118019 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.117995    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/cni-plugins/0.log"
Jul 27 20:24:10.139934 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.139911    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/bond-cni-plugin/0.log"
Jul 27 20:24:10.161765 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.161739    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/routeoverride-cni/0.log"
Jul 27 20:24:10.183741 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.183717    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/whereabouts-cni-bincopy/0.log"
Jul 27 20:24:10.206483 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.206455    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghclq_445d35f0-1473-4e0d-b15a-f867170652e1/whereabouts-cni/0.log"
Jul 27 20:24:10.704305 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.704275    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gw4wp_9225ea5e-34f0-4663-bf0e-58ac3b59f78a/network-metrics-daemon/0.log"
Jul 27 20:24:10.721095 ip-10-0-131-166 kubenswrapper[2559]: I0727 20:24:10.721063    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gw4wp_9225ea5e-34f0-4663-bf0e-58ac3b59f78a/kube-rbac-proxy/0.log"