Jul 27 19:21:48.086552 ip-10-0-130-91 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 19:21:48.086567 ip-10-0-130-91 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 19:21:48.086577 ip-10-0-130-91 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 19:21:48.087100 ip-10-0-130-91 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 19:21:57.815339 ip-10-0-130-91 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 19:21:57.815356 ip-10-0-130-91 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9aa4079e715548dc9e106e8f6d42dbaa --
Jul 27 19:23:48.001766 ip-10-0-130-91 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:23:48.384312 ip-10-0-130-91 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:23:48.384312 ip-10-0-130-91 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:23:48.384312 ip-10-0-130-91 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:23:48.384312 ip-10-0-130-91 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:23:48.384312 ip-10-0-130-91 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:23:48.386767 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.386675    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:23:48.392954 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392933    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:48.392954 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392953    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:48.392954 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392957    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392960    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392963    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392966    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392970    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392974    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392977    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392979    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392982    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392984    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392987    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392990    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392993    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392995    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.392998    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393000    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393005    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393009    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393012    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393015    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:48.393052 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393018    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393021    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393024    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393026    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393029    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393032    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393034    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393038    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393042    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393044    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393047    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393050    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393053    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393056    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393059    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393062    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393064    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393068    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393070    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:48.393553 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393073    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393076    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393078    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393081    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393084    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393087    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393090    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393092    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393094    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393097    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393100    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393103    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393106    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393109    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393111    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393115    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393118    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393121    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393123    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:48.394004 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393125    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393128    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393131    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393133    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393135    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393138    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393141    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393144    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393147    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393149    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393152    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393155    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393158    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393160    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393163    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393166    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393168    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393170    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393173    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393176    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393178    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:48.394488 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393181    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393183    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393185    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393188    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393191    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393193    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393196    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393199    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393202    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393205    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393207    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393211    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393215    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393218    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393221    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393224    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393226    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393228    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393954    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:48.394991 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393961    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393964    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393966    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393970    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393973    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393976    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393979    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393982    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393984    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393987    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393990    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393992    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393995    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.393997    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394000    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394003    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394006    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394008    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394011    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394014    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:48.395497 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394017    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394020    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394022    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394025    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394027    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394030    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394033    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394035    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394038    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394040    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394043    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394046    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394049    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394052    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394054    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394057    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394059    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394062    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394065    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394068    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:48.396002 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394072    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394076    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394079    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394082    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394085    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394088    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394091    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394094    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394097    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394100    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394103    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394105    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394108    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394110    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394113    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394116    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394119    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394122    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394125    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394127    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:48.396505 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394130    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394132    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394135    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394140    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394143    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394146    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394149    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394152    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394154    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394157    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394160    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394163    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394165    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394168    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394170    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394173    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394175    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394178    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394180    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:48.396990 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394183    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394186    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394188    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394191    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394194    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394196    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394200    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394203    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394206    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394209    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394211    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394214    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394216    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394219    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394221    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394224    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394227    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394230    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394234    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:48.397485 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394674    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394680    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394683    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394687    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394690    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394694    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394697    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394699    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394702    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394705    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394707    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394710    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394715    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394718    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394721    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394723    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394726    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394728    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394731    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:48.397953 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394734    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394736    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394739    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394743    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394747    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394750    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394753    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394756    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394759    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394762    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394765    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394767    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394770    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394772    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394775    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394777    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394780    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394783    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394785    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394788    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:48.398409 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394791    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394793    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394797    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394799    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394802    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394806    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394808    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394811    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394813    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394816    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394819    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394821    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394824    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394827    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394831    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394833    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394836    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394839    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394841    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:48.398932 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394844    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394846    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394850    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394853    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394855    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394858    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394861    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394863    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394866    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394868    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394872    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394874    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394877    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394880    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394882    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394885    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394887    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394890    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394894    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394897    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:48.399386 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394899    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394902    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394904    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394907    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394909    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394912    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394914    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394917    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394919    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394922    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394924    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394927    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394929    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394933    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394938    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394940    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394943    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394946    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394948    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394951    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:48.399902 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.394953    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395028    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395036    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395044    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395050    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395056    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395061    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395068    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395074    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395078    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395082    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395085    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395088    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395092    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395095    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395098    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395100    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395103    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395106    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395111    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395114    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395117    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395120    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395123    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:23:48.400410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395127    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395130    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395135    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395138    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395141    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395144    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395147    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395150    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395153    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395157    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395160    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395163    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395166    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395169    2563 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395172    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395176    2563 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395179    2563 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395182    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395186    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395189    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395192    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395196    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395199    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395202    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395204    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:23:48.401015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395208    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395211    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395214    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395216    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395219    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395222    2563 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395225    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395228    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395231    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395236    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395239    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395242    2563 flags.go:64] FLAG: --help="false"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395245    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395248    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395251    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395254    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395257    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395260    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395264    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395266    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395269    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395272    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395275    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395279    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:23:48.401722 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395281    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395284    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395287    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395290    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395292    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395295    2563 flags.go:64] FLAG: --lock-file=""
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395298    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395300    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395303    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395309    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395311    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395314    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395317    2563 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395320    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395323    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395326    2563 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395329    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395335    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395338    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395347    2563 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395350    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395353    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395356    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395359    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395362    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:23:48.402316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395364    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395368    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395375    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395378    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395381    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395384    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395387    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395393    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395396    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395399    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395402    2563 flags.go:64] FLAG: --port="10250"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395405    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395408    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-015d3bba4dd2289f8"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395411    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395414    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395417    2563 flags.go:64] FLAG: --register-node="true"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395420    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395423    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395426    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395429    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395431    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395435    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395438    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395440    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395445    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:23:48.403097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395464    2563 flags.go:64] FLAG: --runonce="false"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395467    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395470    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395473    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395476    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395479    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395482    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395485    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395488    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395491    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395494    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395499    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395502    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395505    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395508    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395511    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395517    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395520    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395522    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395527    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395530    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395533    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395535    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395538    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395541    2563 flags.go:64] FLAG: --v="2"
Jul 27 19:23:48.404086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395545    2563 flags.go:64] FLAG: --version="false"
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395549    2563 flags.go:64] FLAG: --vmodule=""
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395553    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.395556    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395675    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395679    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395683    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395686    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395688    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395691    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395694    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395696    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395699    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395701    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395704    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395707    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395709    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395712    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395715    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395718    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395720    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:48.404850 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395723    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395726    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395729    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395731    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395734    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395737    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395739    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395742    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395744    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395746    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395749    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395751    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395754    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395756    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395759    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395761    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395764    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395767    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395770    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395772    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:48.405358 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395775    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395777    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395780    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395782    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395785    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395787    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395790    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395793    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395795    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395799    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395803    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395807    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395810    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395812    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395815    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395818    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395821    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395823    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395826    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:48.405861 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395828    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395831    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395833    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395836    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395838    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395841    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395844    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395846    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395850    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395853    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395857    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395861    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395865    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395868    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395870    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395873    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395876    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395878    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395881    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:48.406335 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395884    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395886    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395888    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395893    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395895    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395898    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395901    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395903    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395906    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395909    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395915    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395918    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395920    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395923    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395925    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395928    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395930    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395933    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395935    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395938    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:48.406869 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395940    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395943    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395945    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.395949    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.396621    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.405189    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.405207    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.405228    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.405238    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405296    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405301    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405305    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405308    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405310    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:48.407347 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405313    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405316    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405319    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405322    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405325    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405327    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405330    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405333    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405335    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405337    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405340    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405343    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405346    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405348    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405351    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405353    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405356    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405359    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405362    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405364    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:48.407709 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405367    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405370    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405372    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405375    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405379    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405382    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405384    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405387    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405389    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405392    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405394    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405397    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405399    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405402    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405405    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405407    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405410    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405412    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405415    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:48.408189 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405417    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405420    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405424    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405428    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405431    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405434    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405438    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405441    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405444    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405464    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405467    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405470    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405472    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405475    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405478    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405480    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405483    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405487    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405489    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:48.408676 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405492    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405495    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405498    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405500    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405503    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405505    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405508    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405512    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405515    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405518    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405521    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405524    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405526    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405529    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405531    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405534    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405537    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405539    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405543    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:48.409139 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405545    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405548    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405551    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405553    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405555    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405558    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405561    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405563    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405566    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405569    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405572    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405575    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405577    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405580    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405583    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405585    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:48.409620 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405588    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.405594    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405739    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405745    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405748    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405751    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405755    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405759    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405762    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405765    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405768    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405770    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405773    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405775    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405778    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:23:48.410013 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405781    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405783    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405786    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405789    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405791    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405794    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405797    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405799    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405802    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405804    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405807    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405810    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405813    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405815    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405818    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405820    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405823    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405825    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405828    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405830    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:23:48.410382 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405833    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405835    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405838    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405840    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405842    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405845    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405847    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405850    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405852    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405855    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405857    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405861    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405865    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405868    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405871    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405874    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405877    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405880    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405882    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:23:48.410879 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405885    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405888    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405891    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405894    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405897    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405900    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405902    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405905    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405907    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405910    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405912    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405915    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405918    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405920    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405922    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405925    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405927    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405930    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405932    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405935    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:23:48.411331 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405937    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405939    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405942    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405944    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405947    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405949    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405952    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405955    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405957    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405959    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405962    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405964    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405967    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405970    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405972    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405975    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405977    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405980    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405982    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405985    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:23:48.411824 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405987    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405990    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405994    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.405997    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.406000    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.406002    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.406005    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.406010    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.406141    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.408250    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.409596    2563 server.go:1019] "Starting client certificate rotation"
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.409695    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:23:48.412296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.409736    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:23:48.412649 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.412517    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:23:48.413861 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.413840    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:23:48.424870 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.424849    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:23:48.428569 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.428548    2563 log.go:25] "Validated CRI v1 image API"
Jul 27 19:23:48.429940 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.429918    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:23:48.433217 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.433198    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9d5b1cd0-1571-4755-bc6a-34f055436b90:/dev/nvme0n1p4 bd4b742f-67a8-41e8-8187-0f2ddda29d0c:/dev/nvme0n1p3]
Jul 27 19:23:48.433283 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.433218    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:23:48.439546 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.439406    2563 manager.go:216] Machine: {Timestamp:2026-07-27 19:23:48.438903621 +0000 UTC m=+0.325585910 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118781 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d7746a6cc3a08bf9b60cab71cb497 SystemUUID:ec2d7746-a6cc-3a08-bf9b-60cab71cb497 BootID:9aa4079e-7155-48dc-9e10-6e8f6d42dbaa Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7f:1f:ab:ff:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7f:1f:ab:ff:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:95:bd:b3:31:14 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:23:48.439546 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.439530    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:23:48.439683 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.439615    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:23:48.441255 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.441230    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:23:48.441394 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.441258    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:23:48.442444 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.442433    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:23:48.442510 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.442461    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:23:48.442510 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.442469    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:23:48.443095 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.443084    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:23:48.443872 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.443863    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:23:48.445549 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445519    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:23:48.445762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445751    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:23:48.445915 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445905    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:23:48.445947 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445935    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:23:48.445947 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445945    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:23:48.446002 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445961    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:23:48.446002 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445971    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:23:48.446002 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.445980    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:23:48.446412 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.446389    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:23:48.446412 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.446407    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:23:48.449142 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.449119    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:23:48.450874 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.450858    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:23:48.450962 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.450896    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:23:48.452710 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452696    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:23:48.452758 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452716    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:23:48.452758 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452722    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:23:48.452758 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452727    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:23:48.452758 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452737    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:23:48.452758 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452746    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452761    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452767    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452774    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452783    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452791    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452797    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452834    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:23:48.452880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.452843    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:23:48.456537 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.456522    2563 server.go:1268] "Started kubelet"
Jul 27 19:23:48.456673 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.456616    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:23:48.456752 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.456734    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:23:48.456909 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.456864    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:23:48.457434 ip-10-0-130-91 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:23:48.458495 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.458445    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:23:48.458592 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.458497    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:23:48.458592 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.458529    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:23:48.458592 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.458528    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:23:48.459737 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.459722    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:23:48.463054 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.463030    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:23:48.463960 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.462849    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.ec2.internal.18c63bf5a13332fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.ec2.internal,UID:ip-10-0-130-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.ec2.internal,},FirstTimestamp:2026-07-27 19:23:48.456493821 +0000 UTC m=+0.343176110,LastTimestamp:2026-07-27 19:23:48.456493821 +0000 UTC m=+0.343176110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.ec2.internal,}"
Jul 27 19:23:48.465019 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.464964    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:23:48.465615 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.465594    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:23:48.465868 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.465845    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:48.468051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.466411    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:23:48.468051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.466413    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:23:48.468051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.466502    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:23:48.468051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.466571    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:23:48.468051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.466579    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:23:48.468051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.467056    2563 factory.go:55] Registering systemd factory
Jul 27 19:23:48.468051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.467072    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:23:48.468953 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.468935    2563 factory.go:153] Registering CRI-O factory
Jul 27 19:23:48.468953 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.468955    2563 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:23:48.469145 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.469034    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:23:48.469145 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.469057    2563 factory.go:103] Registering Raw factory
Jul 27 19:23:48.469145 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.469070    2563 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:23:48.470490 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.470474    2563 manager.go:349] Starting recovery of all containers
Jul 27 19:23:48.474568 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.474541    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:23:48.474660 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.474628    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:23:48.476412 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:48.476377    2563 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max: no such device
Jul 27 19:23:48.481293 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.481163    2563 manager.go:354] Recovery completed
Jul 27 19:23:48.485295 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.485277    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:48.487132 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.487109    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:48.487214 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.487149    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:48.487214 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.487160    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:48.487790 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.487774    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:23:48.487790 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.487785    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:48.487790 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.487789    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:23:48.487999 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.487808    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:23:48.488527 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.488512    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:48.488582 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.488541    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:48.488582 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.488551    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:48.489431 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.489420    2563 policy_none.go:49] "None policy: Start"
Jul 27 19:23:48.489499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.489437    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:23:48.489499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.489466    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:23:48.489800 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.489723    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.ec2.internal.18c63bf5a306b800  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.ec2.internal,UID:ip-10-0-130-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-91.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.ec2.internal,},FirstTimestamp:2026-07-27 19:23:48.487133184 +0000 UTC m=+0.373815478,LastTimestamp:2026-07-27 19:23:48.487133184 +0000 UTC m=+0.373815478,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.ec2.internal,}"
Jul 27 19:23:48.490742 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.490730    2563 policy_none.go:47] "Start"
Jul 27 19:23:48.498533 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.498424    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.ec2.internal.18c63bf5a3070a74  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.ec2.internal,UID:ip-10-0-130-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-91.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.ec2.internal,},FirstTimestamp:2026-07-27 19:23:48.487154292 +0000 UTC m=+0.373836582,LastTimestamp:2026-07-27 19:23:48.487154292 +0000 UTC m=+0.373836582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.ec2.internal,}"
Jul 27 19:23:48.508692 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.508607    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.ec2.internal.18c63bf5a30730d1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.ec2.internal,UID:ip-10-0-130-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-91.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.ec2.internal,},FirstTimestamp:2026-07-27 19:23:48.487164113 +0000 UTC m=+0.373846403,LastTimestamp:2026-07-27 19:23:48.487164113 +0000 UTC m=+0.373846403,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.ec2.internal,}"
Jul 27 19:23:48.512034 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.512012    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6gpgz"
Jul 27 19:23:48.519018 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.518940    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-91.ec2.internal.18c63bf5a306b800\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-91.ec2.internal.18c63bf5a306b800  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-91.ec2.internal,UID:ip-10-0-130-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-91.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-91.ec2.internal,},FirstTimestamp:2026-07-27 19:23:48.487133184 +0000 UTC m=+0.373815478,LastTimestamp:2026-07-27 19:23:48.488528035 +0000 UTC m=+0.375210324,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-91.ec2.internal,}"
Jul 27 19:23:48.520622 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.520603    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6gpgz"
Jul 27 19:23:48.532089 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.532071    2563 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:23:48.532200 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.532117    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:23:48.532200 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.532128    2563 server.go:87] "Starting device plugin registration server"
Jul 27 19:23:48.532420 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.532408    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:23:48.532488 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.532423    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:23:48.532575 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.532521    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:23:48.532640 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.532607    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:23:48.532640 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.532617    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:23:48.533981 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.533960    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:23:48.534073 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.534009    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:48.563220 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.563180    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:23:48.564626 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.564608    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:23:48.564708 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.564649    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:23:48.564708 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.564673    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:23:48.564806 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.564707    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:23:48.567155 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.567132    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:23:48.633029 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.632994    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:48.633977 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.633958    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:48.634067 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.633990    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:48.634067 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.634000    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:48.634067 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.634023    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.643535 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.643470    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.643535 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.643496    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-91.ec2.internal\": node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:48.664854 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.664795    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"]
Jul 27 19:23:48.665019 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.664899    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:48.665841 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.665826    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:48.665918 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.665855    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:48.665918 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.665867    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:48.667265 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.667245    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:48.667388 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.667271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c4227bbb474763a9fcdb59f70b3d30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"5c4227bbb474763a9fcdb59f70b3d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.667388 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.667302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c4227bbb474763a9fcdb59f70b3d30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"5c4227bbb474763a9fcdb59f70b3d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.667497 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.667388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.667497 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.667415    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:48.668030 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.668014    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:48.668111 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.668038    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:48.668111 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.668048    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:48.668111 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.668072    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:48.668111 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.668095    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:48.668111 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.668105    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:48.669304 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.669287    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.669356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.669323    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:48.670008 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.669989    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:48.670094 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.670022    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:48.670094 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.670037    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:48.675795 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.675779    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:48.691461 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.691419    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-91.ec2.internal\" not found" node="ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.696287 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.696267    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-91.ec2.internal\" not found" node="ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.767465 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.767412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c4227bbb474763a9fcdb59f70b3d30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"5c4227bbb474763a9fcdb59f70b3d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.767465 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.767467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c4227bbb474763a9fcdb59f70b3d30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"5c4227bbb474763a9fcdb59f70b3d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.767660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.767513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c4227bbb474763a9fcdb59f70b3d30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"5c4227bbb474763a9fcdb59f70b3d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.767660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.767515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c4227bbb474763a9fcdb59f70b3d30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal\" (UID: \"5c4227bbb474763a9fcdb59f70b3d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.776784 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.776749    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:48.867597 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.867558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc004288917b78b709be42f999375de6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.ec2.internal\" (UID: \"fc004288917b78b709be42f999375de6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.877746 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.877717    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:48.968493 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.968400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc004288917b78b709be42f999375de6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.ec2.internal\" (UID: \"fc004288917b78b709be42f999375de6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.968594 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.968491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc004288917b78b709be42f999375de6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-91.ec2.internal\" (UID: \"fc004288917b78b709be42f999375de6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.978598 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:48.978565    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:48.995772 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.995748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:48.999789 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:48.999530    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:49.078859 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:49.078804    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:49.179437 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:49.179401    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:49.279955 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:49.279922    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:49.372374 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:49.372342    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:23:49.380162 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:49.380130    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:50.424814 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.424792    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:23:50.425203 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.424932    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:23:50.425203 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.424970    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:23:50.496094 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:50.496060    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:50.539593 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.539545    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:18:49 +0000 UTC" deadline="2028-05-11 01:53:03.552575324 +0000 UTC"
Jul 27 19:23:50.539593 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.539582    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15678h29m13.012996281s"
Jul 27 19:23:50.542724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.542704    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:23:50.543848 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.543830    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:23:50.543973 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.543862    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:23:50.543973 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.543877    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:23:50.596415 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:50.596332    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:50.696962 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:50.696917    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:50.788245 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.788212    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:23:50.797697 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:50.797668    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:50.855019 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:50.854924    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc004288917b78b709be42f999375de6.slice/crio-5f3e6df77caef334f864406dd47496c47e24cbd2837c467d4108df1ace52dcd8 WatchSource:0}: Error finding container 5f3e6df77caef334f864406dd47496c47e24cbd2837c467d4108df1ace52dcd8: Status 404 returned error can't find the container with id 5f3e6df77caef334f864406dd47496c47e24cbd2837c467d4108df1ace52dcd8
Jul 27 19:23:50.855266 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:50.855244    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4227bbb474763a9fcdb59f70b3d30e.slice/crio-8fdfe43eeafb3ca2c43fb638aac9540b78963f06bd42131160b7fbb2a6d199b4 WatchSource:0}: Error finding container 8fdfe43eeafb3ca2c43fb638aac9540b78963f06bd42131160b7fbb2a6d199b4: Status 404 returned error can't find the container with id 8fdfe43eeafb3ca2c43fb638aac9540b78963f06bd42131160b7fbb2a6d199b4
Jul 27 19:23:50.859665 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:50.859651    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:23:50.898394 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:50.898361    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:50.999245 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:50.999216    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-91.ec2.internal\" not found"
Jul 27 19:23:51.070502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.070470    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:23:51.081990 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.081933    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:51.093650 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.093627    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:23:51.094629 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.094617    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal"
Jul 27 19:23:51.109586 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.109517    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:23:51.462967 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.462876    2563 apiserver.go:52] "Watching apiserver"
Jul 27 19:23:51.474489 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.474461    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:23:51.474963 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.474918    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal","openshift-multus/network-metrics-daemon-7zdqh","openshift-network-diagnostics/network-check-target-cc9pq","openshift-network-operator/iptables-alerter-vg7dp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk","openshift-cluster-node-tuning-operator/tuned-bsgwf","openshift-image-registry/node-ca-qlfvd","openshift-multus/multus-additional-cni-plugins-ndtnq","openshift-multus/multus-nhwkb","openshift-ovn-kubernetes/ovnkube-node-84hdm","kube-system/global-pull-secret-syncer-x2zdf","kube-system/konnectivity-agent-srls9","kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal","openshift-dns/node-resolver-7vkzq"]
Jul 27 19:23:51.476421 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.476395    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.479514 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.479488    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:23:51.479709 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.479688    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:23:51.480007 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.479986    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:23:51.480231 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.480210    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-brf6w\""
Jul 27 19:23:51.480638 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.480612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.481177 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.481161    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:23:51.482266 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.482014    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:51.482266 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.482085    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:23:51.483919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.483902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:23:51.484127 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.484109    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:23:51.484406 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.484318    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27w7j\""
Jul 27 19:23:51.484571 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.484551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.485387 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.485369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.486334 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.486314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.498897 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.498865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c65c60fd-5d24-4135-9049-bf1d8368170a-agent-certs\") pod \"konnectivity-agent-srls9\" (UID: \"c65c60fd-5d24-4135-9049-bf1d8368170a\") " pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.499040 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.498926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c65c60fd-5d24-4135-9049-bf1d8368170a-konnectivity-ca\") pod \"konnectivity-agent-srls9\" (UID: \"c65c60fd-5d24-4135-9049-bf1d8368170a\") " pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.499040 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:51.499131 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-iptables-alerter-script\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.499131 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-host-slash\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.500839 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4d328d4-903c-4c73-8afa-f3281045dcc1-serviceca\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.500969 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499555    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:23:51.501099 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.501003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkgz\" (UniqueName: \"kubernetes.io/projected/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-kube-api-access-jxkgz\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.501168 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499602    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:23:51.501168 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.501096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d328d4-903c-4c73-8afa-f3281045dcc1-host\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.501266 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.501187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzhx\" (UniqueName: \"kubernetes.io/projected/e4d328d4-903c-4c73-8afa-f3281045dcc1-kube-api-access-pqzhx\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.501266 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.500024    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:23:51.501266 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.501247    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:23:51.501404 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499843    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:23:51.501459 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499690    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:23:51.501459 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.500353    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v5kjc\""
Jul 27 19:23:51.501551 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.500650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jcnfk\""
Jul 27 19:23:51.501600 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.500811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.501708 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.500722    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n6rs8\""
Jul 27 19:23:51.501708 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.499903    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:23:51.501828 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.500180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:23:51.504425 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.503419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.505067 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.505046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:51.505190 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.505158    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:23:51.506840 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.506823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.507694 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.507654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.507786 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.507731    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:23:51.507882 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.507867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:23:51.507964 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.507905    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:23:51.508225 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.508205    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:23:51.508421 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.508405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jz9n5\""
Jul 27 19:23:51.508488 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.508450    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:23:51.508647 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.508631    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:23:51.508700 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.508685    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.508752 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.508702    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzh8q\""
Jul 27 19:23:51.508806 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.508636    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:23:51.509579 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.509560    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:23:51.510890 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.510871    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:23:51.511106 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.511085    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:23:51.511256 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.511241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:23:51.511418 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.511403    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:23:51.513633 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.513611    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:23:51.514086 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.514070    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:23:51.514723 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.514687    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8hhx\""
Jul 27 19:23:51.514940 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.514924    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:23:51.515434 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.515414    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-whmfv\""
Jul 27 19:23:51.515639 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.515627    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:23:51.546152 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.546126    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h4vpp"
Jul 27 19:23:51.558158 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.558135    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h4vpp"
Jul 27 19:23:51.582963 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.582911    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:23:51.585035 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.584986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" event={"ID":"5c4227bbb474763a9fcdb59f70b3d30e","Type":"ContainerStarted","Data":"8fdfe43eeafb3ca2c43fb638aac9540b78963f06bd42131160b7fbb2a6d199b4"}
Jul 27 19:23:51.586448 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.586421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" event={"ID":"fc004288917b78b709be42f999375de6","Type":"ContainerStarted","Data":"5f3e6df77caef334f864406dd47496c47e24cbd2837c467d4108df1ace52dcd8"}
Jul 27 19:23:51.601378 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-netns\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.601552 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzhx\" (UniqueName: \"kubernetes.io/projected/e4d328d4-903c-4c73-8afa-f3281045dcc1-kube-api-access-pqzhx\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.601552 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c65c60fd-5d24-4135-9049-bf1d8368170a-agent-certs\") pod \"konnectivity-agent-srls9\" (UID: \"c65c60fd-5d24-4135-9049-bf1d8368170a\") " pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.601552 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-cnibin\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.601552 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-sys-fs\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.601552 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-os-release\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-ovn\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-env-overrides\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-lib-modules\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-var-lib-kubelet\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-tuned\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-registration-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-etc-selinux\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-var-lib-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.601813 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-node-log\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.602339 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zsr\" (UniqueName: \"kubernetes.io/projected/d4368d44-7564-4701-b4a5-3ae41bb2afdb-kube-api-access-j5zsr\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.602339 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-kubelet-config\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.602339 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.601888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bvx\" (UniqueName: \"kubernetes.io/projected/44654a09-d2f9-40d1-a976-c6364d2421c3-kube-api-access-b2bvx\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.602339 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602070    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:23:51.602543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxtff\" (UniqueName: \"kubernetes.io/projected/194825d3-9cec-4adc-ab02-acda46dd735d-kube-api-access-sxtff\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.602543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-system-cni-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.602543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-multus-certs\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.602543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c65c60fd-5d24-4135-9049-bf1d8368170a-konnectivity-ca\") pod \"konnectivity-agent-srls9\" (UID: \"c65c60fd-5d24-4135-9049-bf1d8368170a\") " pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.602543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-device-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.602773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-os-release\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.602773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.602773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-iptables-alerter-script\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.602773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51a1f831-6394-45c5-bcff-63948f42a279-cni-binary-copy\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.602773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovnkube-config\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.602773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-modprobe-d\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-host\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dcf779d-232c-4237-90e7-ae88a473bfcd-tmp\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44654a09-d2f9-40d1-a976-c6364d2421c3-tmp-dir\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-etc-kubernetes\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-systemd\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-run\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44654a09-d2f9-40d1-a976-c6364d2421c3-hosts-file\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.602999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-k8s-cni-cncf-io\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c65c60fd-5d24-4135-9049-bf1d8368170a-konnectivity-ca\") pod \"konnectivity-agent-srls9\" (UID: \"c65c60fd-5d24-4135-9049-bf1d8368170a\") " pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.603084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkgz\" (UniqueName: \"kubernetes.io/projected/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-kube-api-access-jxkgz\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-cni-multus\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv5cc\" (UniqueName: \"kubernetes.io/projected/066992ca-a23f-4e17-84b6-c90f68ae7cf3-kube-api-access-dv5cc\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-systemd-units\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-sys\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwsmj\" (UniqueName: \"kubernetes.io/projected/1dcf779d-232c-4237-90e7-ae88a473bfcd-kube-api-access-xwsmj\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovn-node-metrics-cert\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmw6\" (UniqueName: \"kubernetes.io/projected/51a1f831-6394-45c5-bcff-63948f42a279-kube-api-access-pbmw6\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.603556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-run-netns\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-conf-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-log-socket\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovnkube-script-lib\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysconfig\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-kubernetes\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysctl-conf\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-cni-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51a1f831-6394-45c5-bcff-63948f42a279-multus-daemon-config\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-cni-bin\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-system-cni-dir\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.604051 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.603995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-dbus\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-slash\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysctl-d\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-iptables-alerter-script\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-systemd\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-cnibin\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x7fw\" (UniqueName: \"kubernetes.io/projected/3686ad45-b717-4380-945c-c5053ddea1a6-kube-api-access-5x7fw\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4d328d4-903c-4c73-8afa-f3281045dcc1-serviceca\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-socket-dir-parent\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-cni-netd\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d328d4-903c-4c73-8afa-f3281045dcc1-host\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.604690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-socket-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-kubelet\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-hostroot\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4d328d4-903c-4c73-8afa-f3281045dcc1-host\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-host-slash\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-cni-bin\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-kubelet\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-host-slash\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.604593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-etc-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.605333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.605079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4d328d4-903c-4c73-8afa-f3281045dcc1-serviceca\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.606322 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.606295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c65c60fd-5d24-4135-9049-bf1d8368170a-agent-certs\") pod \"konnectivity-agent-srls9\" (UID: \"c65c60fd-5d24-4135-9049-bf1d8368170a\") " pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.614216 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.614185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzhx\" (UniqueName: \"kubernetes.io/projected/e4d328d4-903c-4c73-8afa-f3281045dcc1-kube-api-access-pqzhx\") pod \"node-ca-qlfvd\" (UID: \"e4d328d4-903c-4c73-8afa-f3281045dcc1\") " pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.637604 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.637567    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:23:51.637604 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.637601    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:23:51.637604 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.637616    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5fx6v for pod openshift-network-diagnostics/network-check-target-cc9pq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:51.637870 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.637691    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v podName:61445ea9-016c-45d5-bac9-574b7f18aa5c nodeName:}" failed. No retries permitted until 2026-07-27 19:23:52.13766806 +0000 UTC m=+3.008854693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5fx6v" (UniqueName: "kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v") pod "network-check-target-cc9pq" (UID: "61445ea9-016c-45d5-bac9-574b7f18aa5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:51.640801 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.640771    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkgz\" (UniqueName: \"kubernetes.io/projected/f3de9fc2-f7f0-4e45-8e74-d0d19e842759-kube-api-access-jxkgz\") pod \"iptables-alerter-vg7dp\" (UID: \"f3de9fc2-f7f0-4e45-8e74-d0d19e842759\") " pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.705120 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-socket-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.705120 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-kubelet\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-hostroot\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-cni-bin\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-kubelet\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-kubelet\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-etc-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-netns\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-cnibin\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-cni-bin\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-sys-fs\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-socket-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-os-release\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-ovn\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-etc-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-kubelet\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-env-overrides\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.705356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-sys-fs\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-lib-modules\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-ovn\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-hostroot\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-os-release\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-netns\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-var-lib-kubelet\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-cnibin\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-tuned\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-registration-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-lib-modules\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705498    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-var-lib-kubelet\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-etc-selinux\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-registration-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-var-lib-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-node-log\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zsr\" (UniqueName: \"kubernetes.io/projected/d4368d44-7564-4701-b4a5-3ae41bb2afdb-kube-api-access-j5zsr\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-etc-selinux\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.706205 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-kubelet-config\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705630    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-node-log\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bvx\" (UniqueName: \"kubernetes.io/projected/44654a09-d2f9-40d1-a976-c6364d2421c3-kube-api-access-b2bvx\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-var-lib-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxtff\" (UniqueName: \"kubernetes.io/projected/194825d3-9cec-4adc-ab02-acda46dd735d-kube-api-access-sxtff\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-kubelet-config\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-system-cni-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-multus-certs\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-device-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-os-release\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-env-overrides\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51a1f831-6394-45c5-bcff-63948f42a279-cni-binary-copy\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovnkube-config\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-system-cni-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-modprobe-d\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-host\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dcf779d-232c-4237-90e7-ae88a473bfcd-tmp\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-device-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44654a09-d2f9-40d1-a976-c6364d2421c3-tmp-dir\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.705988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-modprobe-d\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-etc-kubernetes\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-multus-certs\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-systemd\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-run\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-host\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44654a09-d2f9-40d1-a976-c6364d2421c3-hosts-file\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-k8s-cni-cncf-io\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-cni-multus\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv5cc\" (UniqueName: \"kubernetes.io/projected/066992ca-a23f-4e17-84b6-c90f68ae7cf3-kube-api-access-dv5cc\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706192    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-systemd-units\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-sys\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwsmj\" (UniqueName: \"kubernetes.io/projected/1dcf779d-232c-4237-90e7-ae88a473bfcd-kube-api-access-xwsmj\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovn-node-metrics-cert\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-os-release\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.707919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmw6\" (UniqueName: \"kubernetes.io/projected/51a1f831-6394-45c5-bcff-63948f42a279-kube-api-access-pbmw6\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-run-netns\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706337    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-conf-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-log-socket\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovnkube-script-lib\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysconfig\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-kubernetes\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysctl-conf\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706523    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovnkube-config\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-cni-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-run-netns\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51a1f831-6394-45c5-bcff-63948f42a279-multus-daemon-config\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-cni-bin\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-var-lib-cni-multus\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-system-cni-dir\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.708835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-dbus\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-slash\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysctl-d\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51a1f831-6394-45c5-bcff-63948f42a279-cni-binary-copy\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-systemd\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-cnibin\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-systemd-units\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x7fw\" (UniqueName: \"kubernetes.io/projected/3686ad45-b717-4380-945c-c5053ddea1a6-kube-api-access-5x7fw\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-sys\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-socket-dir-parent\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.706988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-cni-netd\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.709556 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-systemd\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-conf-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-run\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-etc-kubernetes\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.707221    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44654a09-d2f9-40d1-a976-c6364d2421c3-tmp-dir\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.707284    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:52.207267273 +0000 UTC m=+3.078453901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysctl-conf\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-run-openvswitch\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44654a09-d2f9-40d1-a976-c6364d2421c3-hosts-file\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-log-socket\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-cnibin\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-cni-dir\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.707790    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:51.710277 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/194825d3-9cec-4adc-ab02-acda46dd735d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:51.707850    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret podName:ad80edfd-2450-4d26-b7a9-2f64b967c9e8 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:52.207833827 +0000 UTC m=+3.079020470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret") pod "global-pull-secret-syncer-x2zdf" (UID: "ad80edfd-2450-4d26-b7a9-2f64b967c9e8") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-multus-socket-dir-parent\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.707972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-cni-netd\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovnkube-script-lib\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysconfig\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3686ad45-b717-4380-945c-c5053ddea1a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-kubernetes\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-slash\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4368d44-7564-4701-b4a5-3ae41bb2afdb-host-cni-bin\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-dbus\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51a1f831-6394-45c5-bcff-63948f42a279-host-run-k8s-cni-cncf-io\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-sysctl-d\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708188    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3686ad45-b717-4380-945c-c5053ddea1a6-system-cni-dir\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-systemd\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51a1f831-6394-45c5-bcff-63948f42a279-multus-daemon-config\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1dcf779d-232c-4237-90e7-ae88a473bfcd-etc-tuned\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.710937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.708881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dcf779d-232c-4237-90e7-ae88a473bfcd-tmp\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.711746 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.709433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4368d44-7564-4701-b4a5-3ae41bb2afdb-ovn-node-metrics-cert\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.723760 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.723673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxtff\" (UniqueName: \"kubernetes.io/projected/194825d3-9cec-4adc-ab02-acda46dd735d-kube-api-access-sxtff\") pod \"aws-ebs-csi-driver-node-6bpqk\" (UID: \"194825d3-9cec-4adc-ab02-acda46dd735d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.725333 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.725246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bvx\" (UniqueName: \"kubernetes.io/projected/44654a09-d2f9-40d1-a976-c6364d2421c3-kube-api-access-b2bvx\") pod \"node-resolver-7vkzq\" (UID: \"44654a09-d2f9-40d1-a976-c6364d2421c3\") " pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:51.725429 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.725399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmw6\" (UniqueName: \"kubernetes.io/projected/51a1f831-6394-45c5-bcff-63948f42a279-kube-api-access-pbmw6\") pod \"multus-nhwkb\" (UID: \"51a1f831-6394-45c5-bcff-63948f42a279\") " pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.725479 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.725458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv5cc\" (UniqueName: \"kubernetes.io/projected/066992ca-a23f-4e17-84b6-c90f68ae7cf3-kube-api-access-dv5cc\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:51.726689 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.726658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zsr\" (UniqueName: \"kubernetes.io/projected/d4368d44-7564-4701-b4a5-3ae41bb2afdb-kube-api-access-j5zsr\") pod \"ovnkube-node-84hdm\" (UID: \"d4368d44-7564-4701-b4a5-3ae41bb2afdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.726799 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.726783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x7fw\" (UniqueName: \"kubernetes.io/projected/3686ad45-b717-4380-945c-c5053ddea1a6-kube-api-access-5x7fw\") pod \"multus-additional-cni-plugins-ndtnq\" (UID: \"3686ad45-b717-4380-945c-c5053ddea1a6\") " pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.727177 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.727154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwsmj\" (UniqueName: \"kubernetes.io/projected/1dcf779d-232c-4237-90e7-ae88a473bfcd-kube-api-access-xwsmj\") pod \"tuned-bsgwf\" (UID: \"1dcf779d-232c-4237-90e7-ae88a473bfcd\") " pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.755512 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.755481    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:23:51.803600 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.803567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qlfvd"
Jul 27 19:23:51.813735 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.813514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:23:51.825725 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.825693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vg7dp"
Jul 27 19:23:51.833859 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.833834    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk"
Jul 27 19:23:51.840870 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.840846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bsgwf"
Jul 27 19:23:51.849230 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.849208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhwkb"
Jul 27 19:23:51.856120 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.856099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ndtnq"
Jul 27 19:23:51.865079 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.865055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:23:51.870335 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:51.870308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vkzq"
Jul 27 19:23:52.210531 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:52.210493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:52.210730 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:52.210542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:52.210730 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210668    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:52.210730 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210693    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:23:52.210730 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:52.210704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:52.210730 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210719    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:23:52.210730 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210730    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:53.210711882 +0000 UTC m=+4.081898510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:52.211062 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210739    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5fx6v for pod openshift-network-diagnostics/network-check-target-cc9pq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:52.211062 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210791    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v podName:61445ea9-016c-45d5-bac9-574b7f18aa5c nodeName:}" failed. No retries permitted until 2026-07-27 19:23:53.210773253 +0000 UTC m=+4.081959881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fx6v" (UniqueName: "kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v") pod "network-check-target-cc9pq" (UID: "61445ea9-016c-45d5-bac9-574b7f18aa5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:52.211062 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210824    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:52.211062 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.210880    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret podName:ad80edfd-2450-4d26-b7a9-2f64b967c9e8 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:53.210864021 +0000 UTC m=+4.082050664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret") pod "global-pull-secret-syncer-x2zdf" (UID: "ad80edfd-2450-4d26-b7a9-2f64b967c9e8") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:52.561047 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:52.560987    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:18:51 +0000 UTC" deadline="2028-02-21 02:51:39.034679624 +0000 UTC"
Jul 27 19:23:52.561047 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:52.561038    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13759h27m46.473646144s"
Jul 27 19:23:52.581249 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:52.581216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:52.581422 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:52.581327    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:23:52.792648 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:52.792612    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65c60fd_5d24_4135_9049_bf1d8368170a.slice/crio-8a274cdf12a872104fbe979e0b57aaa3698463226414740a4becb38c28ccb631 WatchSource:0}: Error finding container 8a274cdf12a872104fbe979e0b57aaa3698463226414740a4becb38c28ccb631: Status 404 returned error can't find the container with id 8a274cdf12a872104fbe979e0b57aaa3698463226414740a4becb38c28ccb631
Jul 27 19:23:52.794223 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:52.794185    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3686ad45_b717_4380_945c_c5053ddea1a6.slice/crio-6a89307846268f90912518d0c692f1bae78ea5afdccbaf594c5c9183a2d51090 WatchSource:0}: Error finding container 6a89307846268f90912518d0c692f1bae78ea5afdccbaf594c5c9183a2d51090: Status 404 returned error can't find the container with id 6a89307846268f90912518d0c692f1bae78ea5afdccbaf594c5c9183a2d51090
Jul 27 19:23:52.795235 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:52.794970    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3de9fc2_f7f0_4e45_8e74_d0d19e842759.slice/crio-a30ef0147cdf0cf3b1a011469e32300d8ba713bbbbe9b855ab4cb675c3f8b754 WatchSource:0}: Error finding container a30ef0147cdf0cf3b1a011469e32300d8ba713bbbbe9b855ab4cb675c3f8b754: Status 404 returned error can't find the container with id a30ef0147cdf0cf3b1a011469e32300d8ba713bbbbe9b855ab4cb675c3f8b754
Jul 27 19:23:52.797066 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:52.797046    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44654a09_d2f9_40d1_a976_c6364d2421c3.slice/crio-668fe1cde7e1866a8fe93702706f7906ac7832fd4c5e9313cd83ffa02f3b1293 WatchSource:0}: Error finding container 668fe1cde7e1866a8fe93702706f7906ac7832fd4c5e9313cd83ffa02f3b1293: Status 404 returned error can't find the container with id 668fe1cde7e1866a8fe93702706f7906ac7832fd4c5e9313cd83ffa02f3b1293
Jul 27 19:23:52.797859 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:52.797769    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4368d44_7564_4701_b4a5_3ae41bb2afdb.slice/crio-9e90ea0860e83622a2dad007a57df886659b4309128c7eb55e48880e2f8cb63e WatchSource:0}: Error finding container 9e90ea0860e83622a2dad007a57df886659b4309128c7eb55e48880e2f8cb63e: Status 404 returned error can't find the container with id 9e90ea0860e83622a2dad007a57df886659b4309128c7eb55e48880e2f8cb63e
Jul 27 19:23:52.805166 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:52.800700    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194825d3_9cec_4adc_ab02_acda46dd735d.slice/crio-7bcbe43c60c09b1c7a1cbbaf0c6f7d997b6fdc9207059867fce112b69bff4b47 WatchSource:0}: Error finding container 7bcbe43c60c09b1c7a1cbbaf0c6f7d997b6fdc9207059867fce112b69bff4b47: Status 404 returned error can't find the container with id 7bcbe43c60c09b1c7a1cbbaf0c6f7d997b6fdc9207059867fce112b69bff4b47
Jul 27 19:23:52.805166 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:23:52.802436    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcf779d_232c_4237_90e7_ae88a473bfcd.slice/crio-5d083d7c0a9d00cdc2d1f68624e06a6a005a8446765cb51eb1c984642722cbf1 WatchSource:0}: Error finding container 5d083d7c0a9d00cdc2d1f68624e06a6a005a8446765cb51eb1c984642722cbf1: Status 404 returned error can't find the container with id 5d083d7c0a9d00cdc2d1f68624e06a6a005a8446765cb51eb1c984642722cbf1
Jul 27 19:23:53.218489 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.218296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:53.218637 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218500    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:53.218637 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.218511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:53.218637 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.218534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:53.218637 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218560    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret podName:ad80edfd-2450-4d26-b7a9-2f64b967c9e8 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:55.218545631 +0000 UTC m=+6.089732259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret") pod "global-pull-secret-syncer-x2zdf" (UID: "ad80edfd-2450-4d26-b7a9-2f64b967c9e8") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:53.218637 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218608    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:53.218838 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218647    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:55.218636947 +0000 UTC m=+6.089823575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:53.218838 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218697    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:23:53.218838 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218707    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:23:53.218838 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218715    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5fx6v for pod openshift-network-diagnostics/network-check-target-cc9pq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:53.218838 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.218738    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v podName:61445ea9-016c-45d5-bac9-574b7f18aa5c nodeName:}" failed. No retries permitted until 2026-07-27 19:23:55.21873095 +0000 UTC m=+6.089917578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fx6v" (UniqueName: "kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v") pod "network-check-target-cc9pq" (UID: "61445ea9-016c-45d5-bac9-574b7f18aa5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:53.561468 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.561407    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:18:51 +0000 UTC" deadline="2028-02-11 09:06:04.834225685 +0000 UTC"
Jul 27 19:23:53.561468 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.561465    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13525h42m11.272764513s"
Jul 27 19:23:53.583566 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.583532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:53.583725 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.583687    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:23:53.584132 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.584110    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:53.584235 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:53.584214    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:23:53.595035 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.595007    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:23:53.605482 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.605445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" event={"ID":"fc004288917b78b709be42f999375de6","Type":"ContainerStarted","Data":"e669590d86a5bd4dbef628a96d0a21d27367a5d9f1299f0d4c926d375ce88c9b"}
Jul 27 19:23:53.613024 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.612935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlfvd" event={"ID":"e4d328d4-903c-4c73-8afa-f3281045dcc1","Type":"ContainerStarted","Data":"da434e084a3631ec6f90e91464ee39b2f4c11fab3eb433cbceee89edae40b407"}
Jul 27 19:23:53.624397 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.624358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhwkb" event={"ID":"51a1f831-6394-45c5-bcff-63948f42a279","Type":"ContainerStarted","Data":"bb55f27435cb45cb05bf02283d96b7088299e3c4f25ab235cc659e9837eda1f6"}
Jul 27 19:23:53.635440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.635394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"9e90ea0860e83622a2dad007a57df886659b4309128c7eb55e48880e2f8cb63e"}
Jul 27 19:23:53.649576 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.649535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vg7dp" event={"ID":"f3de9fc2-f7f0-4e45-8e74-d0d19e842759","Type":"ContainerStarted","Data":"a30ef0147cdf0cf3b1a011469e32300d8ba713bbbbe9b855ab4cb675c3f8b754"}
Jul 27 19:23:53.657402 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.657107    2563 generic.go:356] "Generic (PLEG): container finished" podID="5c4227bbb474763a9fcdb59f70b3d30e" containerID="f9cb456ae30edfd3a77da3c85d695ea2a0571ee139b077c801024597d3686077" exitCode=0
Jul 27 19:23:53.657402 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.657203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" event={"ID":"5c4227bbb474763a9fcdb59f70b3d30e","Type":"ContainerDied","Data":"f9cb456ae30edfd3a77da3c85d695ea2a0571ee139b077c801024597d3686077"}
Jul 27 19:23:53.668637 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.668605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsgwf" event={"ID":"1dcf779d-232c-4237-90e7-ae88a473bfcd","Type":"ContainerStarted","Data":"5d083d7c0a9d00cdc2d1f68624e06a6a005a8446765cb51eb1c984642722cbf1"}
Jul 27 19:23:53.677938 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.677879    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-91.ec2.internal" podStartSLOduration=2.67785978 podStartE2EDuration="2.67785978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:53.624530113 +0000 UTC m=+4.495716766" watchObservedRunningTime="2026-07-27 19:23:53.67785978 +0000 UTC m=+4.549046431"
Jul 27 19:23:53.679846 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.679802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk" event={"ID":"194825d3-9cec-4adc-ab02-acda46dd735d","Type":"ContainerStarted","Data":"7bcbe43c60c09b1c7a1cbbaf0c6f7d997b6fdc9207059867fce112b69bff4b47"}
Jul 27 19:23:53.689793 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.689758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vkzq" event={"ID":"44654a09-d2f9-40d1-a976-c6364d2421c3","Type":"ContainerStarted","Data":"668fe1cde7e1866a8fe93702706f7906ac7832fd4c5e9313cd83ffa02f3b1293"}
Jul 27 19:23:53.691747 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.691719    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerStarted","Data":"6a89307846268f90912518d0c692f1bae78ea5afdccbaf594c5c9183a2d51090"}
Jul 27 19:23:53.696546 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:53.696517    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srls9" event={"ID":"c65c60fd-5d24-4135-9049-bf1d8368170a","Type":"ContainerStarted","Data":"8a274cdf12a872104fbe979e0b57aaa3698463226414740a4becb38c28ccb631"}
Jul 27 19:23:54.581466 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:54.580969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:54.581466 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:54.581106    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:23:54.718525 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:54.718412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" event={"ID":"5c4227bbb474763a9fcdb59f70b3d30e","Type":"ContainerStarted","Data":"5da12bd3876786b95b28c057195299e1cdce26148751f842aa886e2da6770844"}
Jul 27 19:23:54.740395 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:54.740337    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-91.ec2.internal" podStartSLOduration=3.740316928 podStartE2EDuration="3.740316928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:54.739575875 +0000 UTC m=+5.610762526" watchObservedRunningTime="2026-07-27 19:23:54.740316928 +0000 UTC m=+5.611503584"
Jul 27 19:23:55.239849 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:55.239811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:55.240055 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:55.239870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:55.240055 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:55.240026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:55.240202 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240180    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:55.240259 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240247    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret podName:ad80edfd-2450-4d26-b7a9-2f64b967c9e8 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:59.240226807 +0000 UTC m=+10.111413439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret") pod "global-pull-secret-syncer-x2zdf" (UID: "ad80edfd-2450-4d26-b7a9-2f64b967c9e8") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:55.240725 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240656    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:23:55.240725 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240677    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:23:55.240725 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240690    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5fx6v for pod openshift-network-diagnostics/network-check-target-cc9pq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:55.240920 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240734    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v podName:61445ea9-016c-45d5-bac9-574b7f18aa5c nodeName:}" failed. No retries permitted until 2026-07-27 19:23:59.240719913 +0000 UTC m=+10.111906554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fx6v" (UniqueName: "kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v") pod "network-check-target-cc9pq" (UID: "61445ea9-016c-45d5-bac9-574b7f18aa5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:55.240920 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240797    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:55.240920 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.240832    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:23:59.240820405 +0000 UTC m=+10.112007032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:55.583317 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:55.580721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:55.583317 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.580861    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:23:55.583317 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:55.581109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:55.583317 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:55.581228    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:23:56.581930 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:56.581373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:56.581930 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:56.581508    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:23:57.582924 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:57.580643    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:57.582924 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:57.580771    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:23:57.582924 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:57.581259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:57.582924 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:57.581374    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:23:58.580961 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:58.580916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:58.581143 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:58.581066    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:23:59.274130 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:59.274093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:59.274169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:59.274207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274300    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274336    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274335    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274368    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274373    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:07.274351774 +0000 UTC m=+18.145538422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274381    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5fx6v for pod openshift-network-diagnostics/network-check-target-cc9pq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274391    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret podName:ad80edfd-2450-4d26-b7a9-2f64b967c9e8 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:07.274382551 +0000 UTC m=+18.145569179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret") pod "global-pull-secret-syncer-x2zdf" (UID: "ad80edfd-2450-4d26-b7a9-2f64b967c9e8") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:23:59.274538 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.274427    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v podName:61445ea9-016c-45d5-bac9-574b7f18aa5c nodeName:}" failed. No retries permitted until 2026-07-27 19:24:07.274410746 +0000 UTC m=+18.145597394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fx6v" (UniqueName: "kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v") pod "network-check-target-cc9pq" (UID: "61445ea9-016c-45d5-bac9-574b7f18aa5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:23:59.581764 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:59.581727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:23:59.581928 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.581830    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:23:59.582415 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:23:59.582220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:23:59.582415 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:23:59.582335    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:00.580477 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:00.580443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:00.580913 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:00.580559    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:01.581463 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:01.581427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:01.581904 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:01.581427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:01.581904 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:01.581575    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:01.581904 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:01.581688    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:02.581050 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:02.581009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:02.581239 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:02.581151    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:03.580815 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:03.580774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:03.581290 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:03.580934    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:03.581290 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:03.580981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:03.581290 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:03.581079    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:04.581807 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:04.581267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:04.581807 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:04.581409    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:05.581188 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:05.581149    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:05.581359 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:05.581295    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:05.581408 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:05.581358    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:05.581506 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:05.581484    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:06.580990 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:06.580940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:06.581499 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:06.581084    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:07.338650 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:07.338609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:07.338864 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:07.338694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:07.338864 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:07.338721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:07.338864 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338751    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:07.338864 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338833    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret podName:ad80edfd-2450-4d26-b7a9-2f64b967c9e8 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:23.338811026 +0000 UTC m=+34.209997674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret") pod "global-pull-secret-syncer-x2zdf" (UID: "ad80edfd-2450-4d26-b7a9-2f64b967c9e8") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:07.338864 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338835    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:07.338864 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338851    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:07.338864 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338869    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:07.339177 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338881    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5fx6v for pod openshift-network-diagnostics/network-check-target-cc9pq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:07.339177 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338895    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:23.338878851 +0000 UTC m=+34.210065479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:07.339177 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.338927    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v podName:61445ea9-016c-45d5-bac9-574b7f18aa5c nodeName:}" failed. No retries permitted until 2026-07-27 19:24:23.338917082 +0000 UTC m=+34.210103712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fx6v" (UniqueName: "kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v") pod "network-check-target-cc9pq" (UID: "61445ea9-016c-45d5-bac9-574b7f18aa5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:07.580473 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:07.580435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:07.580473 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:07.580464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:07.580704 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.580571    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:07.580760 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:07.580710    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:08.580496 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:08.580455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:08.580941 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:08.580575    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:09.581668 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:09.581619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:09.582080 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:09.581745    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:09.582080 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:09.581846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:09.582080 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:09.581990    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:10.580620 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:10.580578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:10.580776 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:10.580696    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:11.580405 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:11.580370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:11.580987 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:11.580371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:11.580987 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:11.580497    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:11.580987 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:11.580607    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:12.580783 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.580386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:12.581623 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:12.580913    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:12.758468 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.758429    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qlfvd" event={"ID":"e4d328d4-903c-4c73-8afa-f3281045dcc1","Type":"ContainerStarted","Data":"2f34d22d150bdfa674738ff9298fc91e08cd00ca966d661c6a5a7fac31d99995"}
Jul 27 19:24:12.759805 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.759779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhwkb" event={"ID":"51a1f831-6394-45c5-bcff-63948f42a279","Type":"ContainerStarted","Data":"fe55eca4202f4abc85a448936ea7dd1fd315dd8b93d27fa9db0d4af9073ae118"}
Jul 27 19:24:12.762535 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.762510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"3a06e8c5d8c98a4b11c1a07c3cb7fd74208db9129f6d2a2462117c751cf0a3f8"}
Jul 27 19:24:12.762643 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.762587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"cc9f2bfb144a2eeb09551a08ee7705f38355fa462b34b17519da9119f620c12f"}
Jul 27 19:24:12.762695 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.762673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"65da815c0d1ccbe43f0c6c42062d70c77988cc74dda83804b2691aa3b718c898"}
Jul 27 19:24:12.762736 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.762704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"80767ec8041f3457d962cdab0b437de482f7b96a3cf7c138378bfae7e7d6339b"}
Jul 27 19:24:12.762736 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.762731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"6af1d0c0c41937142ed60fae1fd5119629e13d69ecf6b024632faf61eb626dfb"}
Jul 27 19:24:12.762820 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.762760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"8a727388f8fe50d1c5635b629a348cf36dc955695205031199315e4637c5dedd"}
Jul 27 19:24:12.763912 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.763892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bsgwf" event={"ID":"1dcf779d-232c-4237-90e7-ae88a473bfcd","Type":"ContainerStarted","Data":"9f730c224ab6fcd9240ac20a859998952b53c131be92bbcbdd0fa2b7ffe7843e"}
Jul 27 19:24:12.765215 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.765192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk" event={"ID":"194825d3-9cec-4adc-ab02-acda46dd735d","Type":"ContainerStarted","Data":"f218c6fdf2610c8838e117b0807be34bff14dc9cfb6d0611769649b3f4655b05"}
Jul 27 19:24:12.766468 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.766449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vkzq" event={"ID":"44654a09-d2f9-40d1-a976-c6364d2421c3","Type":"ContainerStarted","Data":"cb57415843065cf8f922d57d1bff561d0fdabb0c36774205dde26766c72b2fca"}
Jul 27 19:24:12.767937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.767917    2563 generic.go:356] "Generic (PLEG): container finished" podID="3686ad45-b717-4380-945c-c5053ddea1a6" containerID="9a8455c6ecca23b5977bb5607973e684cac26eb7ae5e5efe8b7473cdab57cc34" exitCode=0
Jul 27 19:24:12.768052 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.767973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerDied","Data":"9a8455c6ecca23b5977bb5607973e684cac26eb7ae5e5efe8b7473cdab57cc34"}
Jul 27 19:24:12.769440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.769376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srls9" event={"ID":"c65c60fd-5d24-4135-9049-bf1d8368170a","Type":"ContainerStarted","Data":"39d4c58fd0b73012d5219053d4fddd79ec091a65d855e5e69958dfa6eefea136"}
Jul 27 19:24:12.776148 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.776109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qlfvd" podStartSLOduration=4.874638646 podStartE2EDuration="23.776094771s" totalImagesPullingTime="18.901456125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:12.77587279 +0000 UTC m=+23.647059450" watchObservedRunningTime="2026-07-27 19:24:12.776094771 +0000 UTC m=+23.647281420"
Jul 27 19:24:12.794197 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.794150    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bsgwf" podStartSLOduration=4.889976284 podStartE2EDuration="23.794136039s" totalImagesPullingTime="18.904159755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:12.793635621 +0000 UTC m=+23.664822294" watchObservedRunningTime="2026-07-27 19:24:12.794136039 +0000 UTC m=+23.665322717"
Jul 27 19:24:12.829552 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.829495    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-srls9" podStartSLOduration=4.916372807 podStartE2EDuration="23.82947794s" totalImagesPullingTime="18.913105133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:12.829064724 +0000 UTC m=+23.700251373" watchObservedRunningTime="2026-07-27 19:24:12.82947794 +0000 UTC m=+23.700664587"
Jul 27 19:24:12.829714 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.829643    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7vkzq" podStartSLOduration=3.919978237 podStartE2EDuration="22.829635991s" totalImagesPullingTime="18.909657754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:12.811562644 +0000 UTC m=+23.682749314" watchObservedRunningTime="2026-07-27 19:24:12.829635991 +0000 UTC m=+23.700822638"
Jul 27 19:24:12.853936 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:12.853890    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nhwkb" podStartSLOduration=4.894010588 podStartE2EDuration="23.853877374s" totalImagesPullingTime="18.959866786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:12.853384875 +0000 UTC m=+23.724571524" watchObservedRunningTime="2026-07-27 19:24:12.853877374 +0000 UTC m=+23.725064022"
Jul 27 19:24:13.187042 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.187014    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:24:13.522365 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.522331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:24:13.522931 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.522915    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:24:13.563135 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.562966    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:24:13.187034042Z","UUID":"019e207c-4a81-4f12-bb0f-551c950ae7dd","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:24:13.571763 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.571733    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:24:13.571927 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.571794    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:24:13.580802 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.580772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:13.581235 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.580773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:13.581235 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:13.580894    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:13.581235 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:13.580987    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:13.773922 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.773820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vg7dp" event={"ID":"f3de9fc2-f7f0-4e45-8e74-d0d19e842759","Type":"ContainerStarted","Data":"025ae64fec4ea1ea7a7dcbd5ac5dcd233ff2dda021398f1050a4228262b7d931"}
Jul 27 19:24:13.776621 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.776591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk" event={"ID":"194825d3-9cec-4adc-ab02-acda46dd735d","Type":"ContainerStarted","Data":"03fd0fa42134a9ad771cfffa89a23cadfa9076a60c1e551cdd994c9e7f0742f2"}
Jul 27 19:24:13.778027 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.778002    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:24:13.778140 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.778065    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-srls9"
Jul 27 19:24:13.795564 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:13.795514    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vg7dp" podStartSLOduration=5.877950314 podStartE2EDuration="24.795498039s" totalImagesPullingTime="18.917547725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:13.794566406 +0000 UTC m=+24.665753054" watchObservedRunningTime="2026-07-27 19:24:13.795498039 +0000 UTC m=+24.666684714"
Jul 27 19:24:14.580929 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:14.580893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:14.581353 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:14.581035    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:14.783543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:14.783455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"c8ae5deb20cda8e002e98f0bb7bc91e7c4a68513578293aa05ff8af33aed690d"}
Jul 27 19:24:14.785806 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:14.785771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk" event={"ID":"194825d3-9cec-4adc-ab02-acda46dd735d","Type":"ContainerStarted","Data":"08c4f91bc05cc80669c87855f60fbfb3387e48734eae41342ea034247697024f"}
Jul 27 19:24:14.808045 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:14.807979    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bpqk" podStartSLOduration=4.463084202 podStartE2EDuration="25.807935857s" totalImagesPullingTime="21.344851655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:14.807689142 +0000 UTC m=+25.678875791" watchObservedRunningTime="2026-07-27 19:24:14.807935857 +0000 UTC m=+25.679122506"
Jul 27 19:24:15.580993 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:15.580959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:15.581531 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:15.580960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:15.581531 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:15.581118    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:15.581531 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:15.581193    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:16.580671 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:16.580629    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:16.580857 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:16.580735    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:17.580767 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.580580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:17.581533 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.580644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:17.581533 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:17.580853    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:17.581533 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:17.580925    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:17.796362 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.796321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" event={"ID":"d4368d44-7564-4701-b4a5-3ae41bb2afdb","Type":"ContainerStarted","Data":"dde8d8e11dfe9c7724617774f349a0452081b4acbf7bb1fded2475aacb56a5e5"}
Jul 27 19:24:17.796573 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.796555    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:24:17.798346 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.798320    2563 generic.go:356] "Generic (PLEG): container finished" podID="3686ad45-b717-4380-945c-c5053ddea1a6" containerID="0d88c319928ffd756c07f8e399db649972d3f92cadb5c920dd0bb41357401221" exitCode=0
Jul 27 19:24:17.798477 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.798371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerDied","Data":"0d88c319928ffd756c07f8e399db649972d3f92cadb5c920dd0bb41357401221"}
Jul 27 19:24:17.813399 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.813370    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:24:17.830081 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:17.830031    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm" podStartSLOduration=9.860013341 podStartE2EDuration="28.830014276s" totalImagesPullingTime="18.970000935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:17.830013193 +0000 UTC m=+28.701199840" watchObservedRunningTime="2026-07-27 19:24:17.830014276 +0000 UTC m=+28.701200903"
Jul 27 19:24:18.581235 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:18.581040    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:18.581717 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:18.581304    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:18.803309 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:18.803285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:24:18.803481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:18.803366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:24:18.818213 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:18.818192    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:24:19.581489 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.581453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:19.581999 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:19.581557    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:19.581999 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.581597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:19.581999 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:19.581677    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:19.806609 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.806578    2563 generic.go:356] "Generic (PLEG): container finished" podID="3686ad45-b717-4380-945c-c5053ddea1a6" containerID="5e5c337afbabd589aecc43151794102e74a59c3a410d59a917664076b867c316" exitCode=0
Jul 27 19:24:19.806760 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.806662    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerDied","Data":"5e5c337afbabd589aecc43151794102e74a59c3a410d59a917664076b867c316"}
Jul 27 19:24:19.937501 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.937425    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2zdf"]
Jul 27 19:24:19.937640 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.937519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:19.937640 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:19.937593    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:19.940040 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.940012    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cc9pq"]
Jul 27 19:24:19.940183 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.940103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:19.940242 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:19.940198    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:19.944867 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.944515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7zdqh"]
Jul 27 19:24:19.944867 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:19.944673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:19.945273 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:19.945195    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:21.581221 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:21.581184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:21.581221 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:21.581203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:21.581800 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:21.581195    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:21.581800 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:21.581301    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:21.581800 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:21.581365    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:21.581800 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:21.581436    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:21.813360 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:21.813330    2563 generic.go:356] "Generic (PLEG): container finished" podID="3686ad45-b717-4380-945c-c5053ddea1a6" containerID="4da30e6d702dd0e73d54fdc5160dc1e737ba27b72e62f37b096ea8c0a46d20f4" exitCode=0
Jul 27 19:24:21.813536 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:21.813409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerDied","Data":"4da30e6d702dd0e73d54fdc5160dc1e737ba27b72e62f37b096ea8c0a46d20f4"}
Jul 27 19:24:23.360108 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:23.360078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:23.360587 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:23.360119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:23.360587 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:23.360152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:23.360587 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360274    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:23.360587 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360330    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret podName:ad80edfd-2450-4d26-b7a9-2f64b967c9e8 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:55.360312934 +0000 UTC m=+66.231499578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret") pod "global-pull-secret-syncer-x2zdf" (UID: "ad80edfd-2450-4d26-b7a9-2f64b967c9e8") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:24:23.360739 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360688    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:24:23.360739 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360705    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:24:23.360739 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360720    2563 projected.go:196] Error preparing data for projected volume kube-api-access-5fx6v for pod openshift-network-diagnostics/network-check-target-cc9pq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:23.360837 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360773    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v podName:61445ea9-016c-45d5-bac9-574b7f18aa5c nodeName:}" failed. No retries permitted until 2026-07-27 19:24:55.360759806 +0000 UTC m=+66.231946436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5fx6v" (UniqueName: "kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v") pod "network-check-target-cc9pq" (UID: "61445ea9-016c-45d5-bac9-574b7f18aa5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:24:23.360837 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360834    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:23.360911 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.360868    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:24:55.360856781 +0000 UTC m=+66.232043412 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:24:23.580801 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:23.580766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:23.580801 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:23.580804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:23.581258 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:23.580772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:23.581258 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.580895    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2zdf" podUID="ad80edfd-2450-4d26-b7a9-2f64b967c9e8"
Jul 27 19:24:23.581258 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.580994    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7zdqh" podUID="066992ca-a23f-4e17-84b6-c90f68ae7cf3"
Jul 27 19:24:23.581258 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:23.581100    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc9pq" podUID="61445ea9-016c-45d5-bac9-574b7f18aa5c"
Jul 27 19:24:24.484681 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.484403    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-91.ec2.internal" event="NodeReady"
Jul 27 19:24:24.485142 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.484775    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:24:24.534792 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.534756    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fc755c8cf-4b5kf"]
Jul 27 19:24:24.536818 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.536796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.539414 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.539389    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x2r4v"]
Jul 27 19:24:24.539879 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.539859    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 19:24:24.540029 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.539897    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mlfrd\""
Jul 27 19:24:24.540029 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.539930    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 19:24:24.540285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.540037    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 19:24:24.541210 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.541188    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.542364 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.542344    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w96pm"]
Jul 27 19:24:24.544042 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.544022    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:24:24.544177 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.544082    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ksszw\""
Jul 27 19:24:24.544318 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.544304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:24:24.544385 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.544323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:24.546890 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.546606    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 19:24:24.547421 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.547096    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:24:24.547421 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.547197    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:24:24.547421 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.547388    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ssdbw\""
Jul 27 19:24:24.547622 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.547425    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:24:24.552031 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.552007    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fc755c8cf-4b5kf"]
Jul 27 19:24:24.557771 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.557751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w96pm"]
Jul 27 19:24:24.562003 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.561976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2r4v"]
Jul 27 19:24:24.671782 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.671740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064e7eb-a738-4115-8229-c66c32af6baf-config-volume\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.672016 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.671790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-certificates\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672016 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.671826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-ca-trust-extracted\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672016 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.671870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672016 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.671897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrzn\" (UniqueName: \"kubernetes.io/projected/6064e7eb-a738-4115-8229-c66c32af6baf-kube-api-access-pkrzn\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.672016 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.671980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-trusted-ca\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6064e7eb-a738-4115-8229-c66c32af6baf-tmp-dir\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-installation-pull-secrets\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsdhs\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-kube-api-access-qsdhs\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-image-registry-private-configuration\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf627c7a-9c73-465b-a60c-8393fdeddab5-cert\") pod \"ingress-canary-w96pm\" (UID: \"cf627c7a-9c73-465b-a60c-8393fdeddab5\") " pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-bound-sa-token\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.672349 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.672350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hw4n\" (UniqueName: \"kubernetes.io/projected/cf627c7a-9c73-465b-a60c-8393fdeddab5-kube-api-access-2hw4n\") pod \"ingress-canary-w96pm\" (UID: \"cf627c7a-9c73-465b-a60c-8393fdeddab5\") " pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:24.773719 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.773636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.773719 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.773684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-image-registry-private-configuration\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.773941 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:24.773805    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:24.773941 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.773846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf627c7a-9c73-465b-a60c-8393fdeddab5-cert\") pod \"ingress-canary-w96pm\" (UID: \"cf627c7a-9c73-465b-a60c-8393fdeddab5\") " pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:24.773941 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:24.773879    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:24:25.273857563 +0000 UTC m=+36.145044214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:24.773941 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.773911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-bound-sa-token\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774196 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hw4n\" (UniqueName: \"kubernetes.io/projected/cf627c7a-9c73-465b-a60c-8393fdeddab5-kube-api-access-2hw4n\") pod \"ingress-canary-w96pm\" (UID: \"cf627c7a-9c73-465b-a60c-8393fdeddab5\") " pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:24.774196 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064e7eb-a738-4115-8229-c66c32af6baf-config-volume\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.774196 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-certificates\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774196 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-ca-trust-extracted\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774196 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774196 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrzn\" (UniqueName: \"kubernetes.io/projected/6064e7eb-a738-4115-8229-c66c32af6baf-kube-api-access-pkrzn\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.774440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-trusted-ca\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774440 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:24.774284    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:24:24.774440 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:24.774302    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:24:24.774440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6064e7eb-a738-4115-8229-c66c32af6baf-tmp-dir\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.774440 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:24.774345    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:24:25.274329773 +0000 UTC m=+36.145516421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:24:24.774440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-installation-pull-secrets\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774393    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsdhs\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-kube-api-access-qsdhs\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-ca-trust-extracted\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6064e7eb-a738-4115-8229-c66c32af6baf-tmp-dir\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.774724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-certificates\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.774724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.774627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6064e7eb-a738-4115-8229-c66c32af6baf-config-volume\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.775449 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.775422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-trusted-ca\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.784021 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.778550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-image-registry-private-configuration\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.784021 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.778592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf627c7a-9c73-465b-a60c-8393fdeddab5-cert\") pod \"ingress-canary-w96pm\" (UID: \"cf627c7a-9c73-465b-a60c-8393fdeddab5\") " pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:24.784021 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.779092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-installation-pull-secrets\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.784286 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.784252    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrzn\" (UniqueName: \"kubernetes.io/projected/6064e7eb-a738-4115-8229-c66c32af6baf-kube-api-access-pkrzn\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:24.785584 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.785557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hw4n\" (UniqueName: \"kubernetes.io/projected/cf627c7a-9c73-465b-a60c-8393fdeddab5-kube-api-access-2hw4n\") pod \"ingress-canary-w96pm\" (UID: \"cf627c7a-9c73-465b-a60c-8393fdeddab5\") " pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:24.785584 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.785589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsdhs\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-kube-api-access-qsdhs\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.787975 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.785574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-bound-sa-token\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:24.866886 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:24.866843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w96pm"
Jul 27 19:24:25.278307 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.278269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:25.278506 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.278384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:25.278506 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:25.278453    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:25.278506 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:25.278493    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:24:25.278506 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:25.278507    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:24:25.278703 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:25.278529    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:24:26.278508952 +0000 UTC m=+37.149695583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:25.278703 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:25.278552    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:24:26.278537469 +0000 UTC m=+37.149724098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:24:25.580909 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.580873    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:25.580909 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.580881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:25.581412 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.581142    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:25.586053 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.586026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v6qr\""
Jul 27 19:24:25.586053 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.586039    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:24:25.586244 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.586076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:24:25.586244 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.586087    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf99\""
Jul 27 19:24:25.586244 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.586135    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:24:25.586396 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.586354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:24:25.969657 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:25.969627    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w96pm"]
Jul 27 19:24:25.972468 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:24:25.972435    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf627c7a_9c73_465b_a60c_8393fdeddab5.slice/crio-ecf1f090946566de26e4e3817727cb63f52dc335ac9c47122fd66ca14e37dd75 WatchSource:0}: Error finding container ecf1f090946566de26e4e3817727cb63f52dc335ac9c47122fd66ca14e37dd75: Status 404 returned error can't find the container with id ecf1f090946566de26e4e3817727cb63f52dc335ac9c47122fd66ca14e37dd75
Jul 27 19:24:26.287309 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:26.287039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:26.287309 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:26.287295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:26.287476 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:26.287187    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:24:26.287476 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:26.287339    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:24:26.287476 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:26.287395    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:24:28.287378499 +0000 UTC m=+39.158565140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:24:26.287476 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:26.287437    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:26.287476 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:26.287474    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:24:28.287462787 +0000 UTC m=+39.158649420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:26.828666 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:26.828623    2563 generic.go:356] "Generic (PLEG): container finished" podID="3686ad45-b717-4380-945c-c5053ddea1a6" containerID="9f6f7d4deca64d9179d2adc20602fd5d9f30d741a3114e28960656d2ef582997" exitCode=0
Jul 27 19:24:26.829474 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:26.828718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerDied","Data":"9f6f7d4deca64d9179d2adc20602fd5d9f30d741a3114e28960656d2ef582997"}
Jul 27 19:24:26.830113 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:26.830090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w96pm" event={"ID":"cf627c7a-9c73-465b-a60c-8393fdeddab5","Type":"ContainerStarted","Data":"ecf1f090946566de26e4e3817727cb63f52dc335ac9c47122fd66ca14e37dd75"}
Jul 27 19:24:27.836382 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:27.836344    2563 generic.go:356] "Generic (PLEG): container finished" podID="3686ad45-b717-4380-945c-c5053ddea1a6" containerID="7e66c912626219bd5495324ce7c5001e83a99f128fb943bd74155bd3f51864ef" exitCode=0
Jul 27 19:24:27.836816 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:27.836404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerDied","Data":"7e66c912626219bd5495324ce7c5001e83a99f128fb943bd74155bd3f51864ef"}
Jul 27 19:24:28.304240 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:28.304200    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:28.304458 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:28.304316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:28.304458 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:28.304374    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:28.304458 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:28.304450    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:24:28.304619 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:28.304464    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:24:28.304619 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:28.304467    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:24:32.304445082 +0000 UTC m=+43.175631709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:28.304619 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:28.304521    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:24:32.30450348 +0000 UTC m=+43.175690111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:24:28.841769 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:28.841740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" event={"ID":"3686ad45-b717-4380-945c-c5053ddea1a6","Type":"ContainerStarted","Data":"c9863b20ea17a733a07649ed526ff2a60790699eca45f11ddfeef98e95ab28d3"}
Jul 27 19:24:28.871230 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:28.871184    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ndtnq" podStartSLOduration=10.22375266 podStartE2EDuration="39.871168542s" totalImagesPullingTime="29.647415882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:28.868832594 +0000 UTC m=+39.740019243" watchObservedRunningTime="2026-07-27 19:24:28.871168542 +0000 UTC m=+39.742355189"
Jul 27 19:24:29.845700 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:29.845445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w96pm" event={"ID":"cf627c7a-9c73-465b-a60c-8393fdeddab5","Type":"ContainerStarted","Data":"49157168c43651b494315496c0dc83943744ab33e7860e50d0938e1dae4c5087"}
Jul 27 19:24:29.863788 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:29.863715    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w96pm" podStartSLOduration=3.081815273 podStartE2EDuration="5.863695657s" totalImagesPullingTime="2.781880384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:29.86357296 +0000 UTC m=+40.734759631" watchObservedRunningTime="2026-07-27 19:24:29.863695657 +0000 UTC m=+40.734882307"
Jul 27 19:24:32.334892 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:32.334846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:32.335343 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:32.334975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:32.335343 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:32.335024    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:32.335343 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:32.335086    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:24:32.335343 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:32.335101    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:24:32.335343 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:32.335089    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:24:40.335072636 +0000 UTC m=+51.206259264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:32.335343 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:32.335175    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:24:40.335153131 +0000 UTC m=+51.206339772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:24:40.392808 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:40.392767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:40.393359 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:40.392826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:40.393359 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:40.392919    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:24:40.393359 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:40.392926    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:40.393359 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:40.392938    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:24:40.393359 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:40.393022    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:24:56.39300236 +0000 UTC m=+67.264188988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:40.393359 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:40.393042    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:24:56.393033895 +0000 UTC m=+67.264220523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:24:50.819206 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:50.819175    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-84hdm"
Jul 27 19:24:55.402824 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.402788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:55.402824 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.402829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:24:55.403263 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.402863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:55.406038 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.406017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:24:55.406103 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.406028    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:24:55.406140 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.406103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:24:55.413500 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:55.413480    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 19:24:55.413597 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:55.413559    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs podName:066992ca-a23f-4e17-84b6-c90f68ae7cf3 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:59.413543587 +0000 UTC m=+130.284730214 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs") pod "network-metrics-daemon-7zdqh" (UID: "066992ca-a23f-4e17-84b6-c90f68ae7cf3") : secret "metrics-daemon-secret" not found
Jul 27 19:24:55.415994 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.415967    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:24:55.417696 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.417676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad80edfd-2450-4d26-b7a9-2f64b967c9e8-original-pull-secret\") pod \"global-pull-secret-syncer-x2zdf\" (UID: \"ad80edfd-2450-4d26-b7a9-2f64b967c9e8\") " pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:55.426746 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.426725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fx6v\" (UniqueName: \"kubernetes.io/projected/61445ea9-016c-45d5-bac9-574b7f18aa5c-kube-api-access-5fx6v\") pod \"network-check-target-cc9pq\" (UID: \"61445ea9-016c-45d5-bac9-574b7f18aa5c\") " pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:55.595931 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.595899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9nf99\""
Jul 27 19:24:55.602553 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.602517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:55.604820 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.604802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2zdf"
Jul 27 19:24:55.747993 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.747935    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2zdf"]
Jul 27 19:24:55.750941 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:24:55.750915    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad80edfd_2450_4d26_b7a9_2f64b967c9e8.slice/crio-d05b21cf46e87e65aef5e7e5da8054a5ce5885fb2375c08283a31b394c5c6519 WatchSource:0}: Error finding container d05b21cf46e87e65aef5e7e5da8054a5ce5885fb2375c08283a31b394c5c6519: Status 404 returned error can't find the container with id d05b21cf46e87e65aef5e7e5da8054a5ce5885fb2375c08283a31b394c5c6519
Jul 27 19:24:55.753917 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.753902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cc9pq"]
Jul 27 19:24:55.758650 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:24:55.758628    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61445ea9_016c_45d5_bac9_574b7f18aa5c.slice/crio-46ee25b0c4191fb39344061f4479091db53ee37235784d1f110c1e07dc563c91 WatchSource:0}: Error finding container 46ee25b0c4191fb39344061f4479091db53ee37235784d1f110c1e07dc563c91: Status 404 returned error can't find the container with id 46ee25b0c4191fb39344061f4479091db53ee37235784d1f110c1e07dc563c91
Jul 27 19:24:55.906231 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.906143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2zdf" event={"ID":"ad80edfd-2450-4d26-b7a9-2f64b967c9e8","Type":"ContainerStarted","Data":"d05b21cf46e87e65aef5e7e5da8054a5ce5885fb2375c08283a31b394c5c6519"}
Jul 27 19:24:55.907184 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:55.907159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cc9pq" event={"ID":"61445ea9-016c-45d5-bac9-574b7f18aa5c","Type":"ContainerStarted","Data":"46ee25b0c4191fb39344061f4479091db53ee37235784d1f110c1e07dc563c91"}
Jul 27 19:24:56.412376 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:56.412343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:24:56.412911 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:56.412395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:24:56.412911 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:56.412511    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:24:56.412911 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:56.412526    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:24:56.412911 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:56.412550    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:24:56.412911 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:56.412573    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:25:28.412555161 +0000 UTC m=+99.283741790 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:24:56.412911 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:24:56.412606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:25:28.412588374 +0000 UTC m=+99.283775005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:24:58.917457 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:58.917329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cc9pq" event={"ID":"61445ea9-016c-45d5-bac9-574b7f18aa5c","Type":"ContainerStarted","Data":"6c297a05207e8a1339734f5ff52112a80f14e359d4d1823a2696e1a9b8b7a318"}
Jul 27 19:24:58.917862 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:58.917482    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:24:58.938429 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:24:58.938378    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cc9pq" podStartSLOduration=67.041938371 podStartE2EDuration="1m9.938362822s" totalImagesPullingTime="2.896424451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:58.93689654 +0000 UTC m=+69.808083216" watchObservedRunningTime="2026-07-27 19:24:58.938362822 +0000 UTC m=+69.809549470"
Jul 27 19:25:00.924407 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:00.924369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2zdf" event={"ID":"ad80edfd-2450-4d26-b7a9-2f64b967c9e8","Type":"ContainerStarted","Data":"d0fa1733301b864a64e5ad8f91680be0d0119a56ff8175924f30cbe96b59ae91"}
Jul 27 19:25:00.943876 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:00.943828    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x2zdf" podStartSLOduration=66.584773212 podStartE2EDuration="1m10.943812056s" totalImagesPullingTime="4.359038844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:00.943464688 +0000 UTC m=+71.814651337" watchObservedRunningTime="2026-07-27 19:25:00.943812056 +0000 UTC m=+71.814998705"
Jul 27 19:25:28.442040 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:28.441900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:25:28.442040 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:28.441967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:25:28.442512 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:28.442069    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:25:28.442512 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:28.442072    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:25:28.442512 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:28.442090    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: secret "image-registry-tls" not found
Jul 27 19:25:28.442512 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:28.442121    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls podName:6064e7eb-a738-4115-8229-c66c32af6baf nodeName:}" failed. No retries permitted until 2026-07-27 19:26:32.442108018 +0000 UTC m=+163.313294645 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls") pod "dns-default-x2r4v" (UID: "6064e7eb-a738-4115-8229-c66c32af6baf") : secret "dns-default-metrics-tls" not found
Jul 27 19:25:28.442512 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:28.442133    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls podName:9c3b7795-5eb6-4224-bf5c-45db0dc6b17d nodeName:}" failed. No retries permitted until 2026-07-27 19:26:32.442127791 +0000 UTC m=+163.313314418 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls") pod "image-registry-7fc755c8cf-4b5kf" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d") : secret "image-registry-tls" not found
Jul 27 19:25:29.922727 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:29.922695    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cc9pq"
Jul 27 19:25:36.437057 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.437023    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"]
Jul 27 19:25:36.439641 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.439624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"
Jul 27 19:25:36.442436 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.442413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2s4v6\""
Jul 27 19:25:36.449810 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.449791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"]
Jul 27 19:25:36.525677 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.525642    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"]
Jul 27 19:25:36.527399 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.527384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:36.530144 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.530117    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 27 19:25:36.530242 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.530214    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f796j\""
Jul 27 19:25:36.530499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.530487    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 27 19:25:36.537152 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.537133    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-xnbmk"]
Jul 27 19:25:36.538984 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.538968    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.541391 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.541374    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:25:36.542517 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.542503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 27 19:25:36.542621 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.542605    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gzg46\""
Jul 27 19:25:36.543534 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.543520    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 27 19:25:36.543616 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.543538    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:25:36.550631 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.550611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 27 19:25:36.551979 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.551939    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"]
Jul 27 19:25:36.553188 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.553170    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-xnbmk"]
Jul 27 19:25:36.598588 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.598557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd2ns\" (UniqueName: \"kubernetes.io/projected/0b4dc094-9bf5-481f-80f1-cc876e3196ab-kube-api-access-vd2ns\") pod \"network-check-source-7d88cb55d8-nmd8v\" (UID: \"0b4dc094-9bf5-481f-80f1-cc876e3196ab\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"
Jul 27 19:25:36.699391 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b00a821-342c-461d-9c28-202f8ff3bf0e-tmp\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.699391 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:36.699577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b00a821-342c-461d-9c28-202f8ff3bf0e-serving-cert\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.699577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd2ns\" (UniqueName: \"kubernetes.io/projected/0b4dc094-9bf5-481f-80f1-cc876e3196ab-kube-api-access-vd2ns\") pod \"network-check-source-7d88cb55d8-nmd8v\" (UID: \"0b4dc094-9bf5-481f-80f1-cc876e3196ab\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"
Jul 27 19:25:36.699577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b00a821-342c-461d-9c28-202f8ff3bf0e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.699577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9b00a821-342c-461d-9c28-202f8ff3bf0e-snapshots\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.699577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf4d9e1a-4b71-4e48-922a-641b6db539b0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:36.699753 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b00a821-342c-461d-9c28-202f8ff3bf0e-service-ca-bundle\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.699753 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.699616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66bc2\" (UniqueName: \"kubernetes.io/projected/9b00a821-342c-461d-9c28-202f8ff3bf0e-kube-api-access-66bc2\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.710691 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.710659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd2ns\" (UniqueName: \"kubernetes.io/projected/0b4dc094-9bf5-481f-80f1-cc876e3196ab-kube-api-access-vd2ns\") pod \"network-check-source-7d88cb55d8-nmd8v\" (UID: \"0b4dc094-9bf5-481f-80f1-cc876e3196ab\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"
Jul 27 19:25:36.747593 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.747559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"
Jul 27 19:25:36.800589 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9b00a821-342c-461d-9c28-202f8ff3bf0e-snapshots\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.800762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf4d9e1a-4b71-4e48-922a-641b6db539b0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:36.800762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b00a821-342c-461d-9c28-202f8ff3bf0e-service-ca-bundle\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.800762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66bc2\" (UniqueName: \"kubernetes.io/projected/9b00a821-342c-461d-9c28-202f8ff3bf0e-kube-api-access-66bc2\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.800762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b00a821-342c-461d-9c28-202f8ff3bf0e-tmp\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.800762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:36.800762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b00a821-342c-461d-9c28-202f8ff3bf0e-serving-cert\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.800762 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.800744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b00a821-342c-461d-9c28-202f8ff3bf0e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.801237 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.801217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b00a821-342c-461d-9c28-202f8ff3bf0e-tmp\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.801335 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:36.801320    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:25:36.801410 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:36.801397    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert podName:cf4d9e1a-4b71-4e48-922a-641b6db539b0 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:37.301376994 +0000 UTC m=+108.172563629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dndtm" (UID: "cf4d9e1a-4b71-4e48-922a-641b6db539b0") : secret "networking-console-plugin-cert" not found
Jul 27 19:25:36.801476 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.801439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b00a821-342c-461d-9c28-202f8ff3bf0e-service-ca-bundle\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.801539 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.801522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf4d9e1a-4b71-4e48-922a-641b6db539b0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:36.802010 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.801916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9b00a821-342c-461d-9c28-202f8ff3bf0e-snapshots\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.802134 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.802115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b00a821-342c-461d-9c28-202f8ff3bf0e-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.803798 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.803778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9b00a821-342c-461d-9c28-202f8ff3bf0e-serving-cert\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.814241 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.814220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66bc2\" (UniqueName: \"kubernetes.io/projected/9b00a821-342c-461d-9c28-202f8ff3bf0e-kube-api-access-66bc2\") pod \"insights-operator-5885fdb759-xnbmk\" (UID: \"9b00a821-342c-461d-9c28-202f8ff3bf0e\") " pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.846510 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.846477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:25:36.874535 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.874508    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v"]
Jul 27 19:25:36.878351 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:25:36.878327    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4dc094_9bf5_481f_80f1_cc876e3196ab.slice/crio-1354757672b34483339a7e0ff0769c45e139d044c2ebe3ab9b38eed5cb06daa1 WatchSource:0}: Error finding container 1354757672b34483339a7e0ff0769c45e139d044c2ebe3ab9b38eed5cb06daa1: Status 404 returned error can't find the container with id 1354757672b34483339a7e0ff0769c45e139d044c2ebe3ab9b38eed5cb06daa1
Jul 27 19:25:36.980403 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:36.980378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-xnbmk"]
Jul 27 19:25:36.982941 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:25:36.982915    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b00a821_342c_461d_9c28_202f8ff3bf0e.slice/crio-99845c8bc517c6342894319aa68a3b1aafba3a5f6e36ff14afa1e62c203035be WatchSource:0}: Error finding container 99845c8bc517c6342894319aa68a3b1aafba3a5f6e36ff14afa1e62c203035be: Status 404 returned error can't find the container with id 99845c8bc517c6342894319aa68a3b1aafba3a5f6e36ff14afa1e62c203035be
Jul 27 19:25:37.009329 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:37.009288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-xnbmk" event={"ID":"9b00a821-342c-461d-9c28-202f8ff3bf0e","Type":"ContainerStarted","Data":"99845c8bc517c6342894319aa68a3b1aafba3a5f6e36ff14afa1e62c203035be"}
Jul 27 19:25:37.010647 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:37.010621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v" event={"ID":"0b4dc094-9bf5-481f-80f1-cc876e3196ab","Type":"ContainerStarted","Data":"8ef67fc392fc511eb2d33e262137f1c1c2aff76cdb196d652d4b0abdaa945d6e"}
Jul 27 19:25:37.010770 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:37.010664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v" event={"ID":"0b4dc094-9bf5-481f-80f1-cc876e3196ab","Type":"ContainerStarted","Data":"1354757672b34483339a7e0ff0769c45e139d044c2ebe3ab9b38eed5cb06daa1"}
Jul 27 19:25:37.031439 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:37.031392    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nmd8v" podStartSLOduration=1.031376055 podStartE2EDuration="1.031376055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:37.030742139 +0000 UTC m=+107.901928808" watchObservedRunningTime="2026-07-27 19:25:37.031376055 +0000 UTC m=+107.902562683"
Jul 27 19:25:37.302661 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:37.302614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:37.302862 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:37.302803    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:25:37.302928 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:37.302888    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert podName:cf4d9e1a-4b71-4e48-922a-641b6db539b0 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:38.302864817 +0000 UTC m=+109.174051444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dndtm" (UID: "cf4d9e1a-4b71-4e48-922a-641b6db539b0") : secret "networking-console-plugin-cert" not found
Jul 27 19:25:38.310625 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:38.310588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:38.311097 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:38.310768    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:25:38.311097 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:38.310871    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert podName:cf4d9e1a-4b71-4e48-922a-641b6db539b0 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:40.310848673 +0000 UTC m=+111.182035303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dndtm" (UID: "cf4d9e1a-4b71-4e48-922a-641b6db539b0") : secret "networking-console-plugin-cert" not found
Jul 27 19:25:39.018034 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:39.017993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-xnbmk" event={"ID":"9b00a821-342c-461d-9c28-202f8ff3bf0e","Type":"ContainerStarted","Data":"80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc"}
Jul 27 19:25:39.041352 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:39.041295    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-xnbmk" podStartSLOduration=1.22950283 podStartE2EDuration="3.041280999s" totalImagesPullingTime="1.811778169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:39.040378011 +0000 UTC m=+109.911564679" watchObservedRunningTime="2026-07-27 19:25:39.041280999 +0000 UTC m=+109.912467647"
Jul 27 19:25:40.328426 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.328395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:40.328794 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:40.328507    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:25:40.328794 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:40.328559    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert podName:cf4d9e1a-4b71-4e48-922a-641b6db539b0 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.328544955 +0000 UTC m=+115.199731584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dndtm" (UID: "cf4d9e1a-4b71-4e48-922a-641b6db539b0") : secret "networking-console-plugin-cert" not found
Jul 27 19:25:40.427047 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.426996    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9w9xz"]
Jul 27 19:25:40.429885 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.429853    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.433155 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.433120    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:25:40.433645 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.433627    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:25:40.434506 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.434485    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kpwnj\""
Jul 27 19:25:40.440495 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.440473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9w9xz"]
Jul 27 19:25:40.529407 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.529373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-data-volume\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.529407 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.529406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.529586 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.529478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.529586 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.529527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-crio-socket\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.529586 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.529548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjx9\" (UniqueName: \"kubernetes.io/projected/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-api-access-lwjx9\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.630259 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.630154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.630259 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.630220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-crio-socket\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.630259 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.630253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjx9\" (UniqueName: \"kubernetes.io/projected/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-api-access-lwjx9\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.630541 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.630297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-crio-socket\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.630541 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:40.630314    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:40.630541 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:40.630371    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:41.130355411 +0000 UTC m=+112.001542038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:40.630541 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.630317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-data-volume\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.630541 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.630427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.630541 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:40.630508    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:40.630765 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:40.630552    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:41.13053865 +0000 UTC m=+112.001725278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:40.630765 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.630623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-data-volume\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:40.640467 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:40.640437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjx9\" (UniqueName: \"kubernetes.io/projected/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-api-access-lwjx9\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:41.135263 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:41.135222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:41.135436 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:41.135290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:41.135436 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:41.135372    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:41.135436 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:41.135375    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:41.135436 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:41.135435    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:42.135419939 +0000 UTC m=+113.006606566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:41.135559 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:41.135482    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:42.135465962 +0000 UTC m=+113.006652590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:42.143102 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:42.143065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:42.143529 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:42.143126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:42.143529 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:42.143198    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:42.143529 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:42.143219    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:42.143529 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:42.143267    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.143254099 +0000 UTC m=+115.014440726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:42.143529 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:42.143280    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:44.143273685 +0000 UTC m=+115.014460313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:42.217939 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:42.217908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vkzq_44654a09-d2f9-40d1-a976-c6364d2421c3/dns-node-resolver/0.log"
Jul 27 19:25:43.086053 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.086017    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hz4v6"]
Jul 27 19:25:43.088125 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.088084    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.091555 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.091530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 19:25:43.092654 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.092637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 19:25:43.092773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.092658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vtml7\""
Jul 27 19:25:43.092773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.092642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 19:25:43.092914 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.092902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 19:25:43.105488 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.105463    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hz4v6"]
Jul 27 19:25:43.251660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.251617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s77c7\" (UniqueName: \"kubernetes.io/projected/b3ec81c9-6459-4953-a403-be25fd88b421-kube-api-access-s77c7\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.252075 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.251765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b3ec81c9-6459-4953-a403-be25fd88b421-signing-cabundle\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.252075 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.251798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b3ec81c9-6459-4953-a403-be25fd88b421-signing-key\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.353148 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.353044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b3ec81c9-6459-4953-a403-be25fd88b421-signing-key\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.353148 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.353108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s77c7\" (UniqueName: \"kubernetes.io/projected/b3ec81c9-6459-4953-a403-be25fd88b421-kube-api-access-s77c7\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.353396 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.353194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b3ec81c9-6459-4953-a403-be25fd88b421-signing-cabundle\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.353810 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.353790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b3ec81c9-6459-4953-a403-be25fd88b421-signing-cabundle\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.355621 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.355598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b3ec81c9-6459-4953-a403-be25fd88b421-signing-key\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.364306 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.364284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s77c7\" (UniqueName: \"kubernetes.io/projected/b3ec81c9-6459-4953-a403-be25fd88b421-kube-api-access-s77c7\") pod \"service-ca-658d7b7c78-hz4v6\" (UID: \"b3ec81c9-6459-4953-a403-be25fd88b421\") " pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.397908 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.397880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6"
Jul 27 19:25:43.531309 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.531276    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-hz4v6"]
Jul 27 19:25:43.533773 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:25:43.533748    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ec81c9_6459_4953_a403_be25fd88b421.slice/crio-4d51e3fb134ff23ed01932be023979d004899c82bc7621c5499f2c42d496669d WatchSource:0}: Error finding container 4d51e3fb134ff23ed01932be023979d004899c82bc7621c5499f2c42d496669d: Status 404 returned error can't find the container with id 4d51e3fb134ff23ed01932be023979d004899c82bc7621c5499f2c42d496669d
Jul 27 19:25:43.618659 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:43.618581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfvd_e4d328d4-903c-4c73-8afa-f3281045dcc1/node-ca/0.log"
Jul 27 19:25:44.031269 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:44.031196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6" event={"ID":"b3ec81c9-6459-4953-a403-be25fd88b421","Type":"ContainerStarted","Data":"4d51e3fb134ff23ed01932be023979d004899c82bc7621c5499f2c42d496669d"}
Jul 27 19:25:44.160491 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:44.160454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:44.160681 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:44.160542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:44.160681 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:44.160552    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:44.160681 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:44.160636    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:48.160614498 +0000 UTC m=+119.031801129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:44.160861 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:44.160731    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:44.160861 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:44.160795    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:48.160778368 +0000 UTC m=+119.031965000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:44.221919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:44.221884    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w96pm_cf627c7a-9c73-465b-a60c-8393fdeddab5/serve-healthcheck-canary/0.log"
Jul 27 19:25:44.362045 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:44.362011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:44.362540 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:44.362183    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:25:44.362540 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:44.362252    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert podName:cf4d9e1a-4b71-4e48-922a-641b6db539b0 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:52.362235671 +0000 UTC m=+123.233422302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dndtm" (UID: "cf4d9e1a-4b71-4e48-922a-641b6db539b0") : secret "networking-console-plugin-cert" not found
Jul 27 19:25:46.043237 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:46.043199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6" event={"ID":"b3ec81c9-6459-4953-a403-be25fd88b421","Type":"ContainerStarted","Data":"e07c8894638d73d25efd791378564f198c54068e5f1bbcf463905080a6317d8d"}
Jul 27 19:25:46.071164 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:46.071104    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-hz4v6" podStartSLOduration=0.976396191 podStartE2EDuration="3.071089342s" totalImagesPullingTime="2.094693151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:46.069916682 +0000 UTC m=+116.941103332" watchObservedRunningTime="2026-07-27 19:25:46.071089342 +0000 UTC m=+116.942275993"
Jul 27 19:25:48.195917 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:48.195882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:48.196323 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:48.195992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:48.196323 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:48.196031    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:25:48.196323 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:48.196138    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:56.196120807 +0000 UTC m=+127.067307441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : configmap "kube-rbac-proxy" not found
Jul 27 19:25:48.196323 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:48.196139    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:48.196323 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:48.196205    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:56.196193939 +0000 UTC m=+127.067380568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:52.428999 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:52.428939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:25:52.429384 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:52.429122    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 27 19:25:52.429384 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:52.429199    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert podName:cf4d9e1a-4b71-4e48-922a-641b6db539b0 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:08.429182163 +0000 UTC m=+139.300368791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-dndtm" (UID: "cf4d9e1a-4b71-4e48-922a-641b6db539b0") : secret "networking-console-plugin-cert" not found
Jul 27 19:25:56.259316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:56.259287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:56.259706 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:56.259343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:56.259706 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:56.259447    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:56.259706 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:25:56.259497    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls podName:83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e nodeName:}" failed. No retries permitted until 2026-07-27 19:26:12.259484577 +0000 UTC m=+143.130671204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9w9xz" (UID: "83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:25:56.259839 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:56.259820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:25:59.486271 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:59.486216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:25:59.488710 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:59.488684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066992ca-a23f-4e17-84b6-c90f68ae7cf3-metrics-certs\") pod \"network-metrics-daemon-7zdqh\" (UID: \"066992ca-a23f-4e17-84b6-c90f68ae7cf3\") " pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:25:59.503183 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:59.503153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9v6qr\""
Jul 27 19:25:59.509878 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:59.509859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7zdqh"
Jul 27 19:25:59.638310 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:25:59.638289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7zdqh"]
Jul 27 19:25:59.640681 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:25:59.640652    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066992ca_a23f_4e17_84b6_c90f68ae7cf3.slice/crio-f26d396152325630800b0db0307b1b567deaa61cd14697d6239653e59c6b3024 WatchSource:0}: Error finding container f26d396152325630800b0db0307b1b567deaa61cd14697d6239653e59c6b3024: Status 404 returned error can't find the container with id f26d396152325630800b0db0307b1b567deaa61cd14697d6239653e59c6b3024
Jul 27 19:26:00.089553 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:00.089514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7zdqh" event={"ID":"066992ca-a23f-4e17-84b6-c90f68ae7cf3","Type":"ContainerStarted","Data":"f26d396152325630800b0db0307b1b567deaa61cd14697d6239653e59c6b3024"}
Jul 27 19:26:01.094311 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:01.094268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7zdqh" event={"ID":"066992ca-a23f-4e17-84b6-c90f68ae7cf3","Type":"ContainerStarted","Data":"31469c9b58ae28b38a209fc704311a75a39fc3b83eb74a9db703dc1e4c7e1941"}
Jul 27 19:26:01.094311 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:01.094320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7zdqh" event={"ID":"066992ca-a23f-4e17-84b6-c90f68ae7cf3","Type":"ContainerStarted","Data":"83f3c36212bb376eb4162d8b6cdeadd46988603639f403789aea4e4dea2612f2"}
Jul 27 19:26:01.114286 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:01.114221    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7zdqh" podStartSLOduration=131.2668634 podStartE2EDuration="2m12.114200931s" totalImagesPullingTime="847.337531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:01.113063893 +0000 UTC m=+131.984250542" watchObservedRunningTime="2026-07-27 19:26:01.114200931 +0000 UTC m=+131.985387582"
Jul 27 19:26:06.907383 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.907351    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"]
Jul 27 19:26:06.909449 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.909428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:06.912465 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.912446    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 19:26:06.914816 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.914797    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 19:26:06.914911 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.914839    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 19:26:06.914911 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.914856    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 19:26:06.924870 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.924848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"]
Jul 27 19:26:06.943652 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.943619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f30deaa4-e419-4335-832d-ce90bad2a0b3-tmp\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:06.943779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.943676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f30deaa4-e419-4335-832d-ce90bad2a0b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:06.943834 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:06.943815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gfr\" (UniqueName: \"kubernetes.io/projected/f30deaa4-e419-4335-832d-ce90bad2a0b3-kube-api-access-h4gfr\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.044265 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.044234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gfr\" (UniqueName: \"kubernetes.io/projected/f30deaa4-e419-4335-832d-ce90bad2a0b3-kube-api-access-h4gfr\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.044265 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.044269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f30deaa4-e419-4335-832d-ce90bad2a0b3-tmp\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.044463 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.044296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f30deaa4-e419-4335-832d-ce90bad2a0b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.044760 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.044727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f30deaa4-e419-4335-832d-ce90bad2a0b3-tmp\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.047059 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.047040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f30deaa4-e419-4335-832d-ce90bad2a0b3-klusterlet-config\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.057620 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.057586    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gfr\" (UniqueName: \"kubernetes.io/projected/f30deaa4-e419-4335-832d-ce90bad2a0b3-kube-api-access-h4gfr\") pod \"klusterlet-addon-workmgr-69fd6cb47f-tbsp4\" (UID: \"f30deaa4-e419-4335-832d-ce90bad2a0b3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.218811 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.218721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:07.342834 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:07.342809    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"]
Jul 27 19:26:07.344656 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:26:07.344622    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30deaa4_e419_4335_832d_ce90bad2a0b3.slice/crio-44a8d077616a90ba0c80ddf34588a7823568ee9a3e9f5defe757a7b20010f96a WatchSource:0}: Error finding container 44a8d077616a90ba0c80ddf34588a7823568ee9a3e9f5defe757a7b20010f96a: Status 404 returned error can't find the container with id 44a8d077616a90ba0c80ddf34588a7823568ee9a3e9f5defe757a7b20010f96a
Jul 27 19:26:08.121856 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:08.121822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4" event={"ID":"f30deaa4-e419-4335-832d-ce90bad2a0b3","Type":"ContainerStarted","Data":"44a8d077616a90ba0c80ddf34588a7823568ee9a3e9f5defe757a7b20010f96a"}
Jul 27 19:26:08.457306 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:08.457116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:26:08.460206 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:08.460164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf4d9e1a-4b71-4e48-922a-641b6db539b0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-dndtm\" (UID: \"cf4d9e1a-4b71-4e48-922a-641b6db539b0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:26:08.638959 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:08.638918    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f796j\""
Jul 27 19:26:08.646338 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:08.646311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"
Jul 27 19:26:08.799571 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:08.799530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-dndtm"]
Jul 27 19:26:09.539744 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:26:09.539703    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4d9e1a_4b71_4e48_922a_641b6db539b0.slice/crio-a2dbbd59ea265df148e1525bd74c0afb20062e621dc69edd2f946ee979867321 WatchSource:0}: Error finding container a2dbbd59ea265df148e1525bd74c0afb20062e621dc69edd2f946ee979867321: Status 404 returned error can't find the container with id a2dbbd59ea265df148e1525bd74c0afb20062e621dc69edd2f946ee979867321
Jul 27 19:26:10.130192 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:10.130156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm" event={"ID":"cf4d9e1a-4b71-4e48-922a-641b6db539b0","Type":"ContainerStarted","Data":"a2dbbd59ea265df148e1525bd74c0afb20062e621dc69edd2f946ee979867321"}
Jul 27 19:26:11.134963 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.134911    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4" event={"ID":"f30deaa4-e419-4335-832d-ce90bad2a0b3","Type":"ContainerStarted","Data":"02b003033d71794a0ed45d06deb3fae49e63d708fddfea8eedf0ab89728ba0ab"}
Jul 27 19:26:11.135353 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.135144    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:11.136796 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.136776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4"
Jul 27 19:26:11.157248 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.157187    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69fd6cb47f-tbsp4" podStartSLOduration=1.536552102 podStartE2EDuration="5.157172363s" totalImagesPullingTime="3.620620261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:11.156211273 +0000 UTC m=+142.027397917" watchObservedRunningTime="2026-07-27 19:26:11.157172363 +0000 UTC m=+142.028358991"
Jul 27 19:26:11.557082 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.557046    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"]
Jul 27 19:26:11.558909 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.558891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:11.562388 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.562366    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9vfbm\""
Jul 27 19:26:11.562708 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.562681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 19:26:11.570099 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.570078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"]
Jul 27 19:26:11.687369 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.686587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9fd66395-7ab1-4620-b80c-94e506e1e78a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-4qvjs\" (UID: \"9fd66395-7ab1-4620-b80c-94e506e1e78a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:11.787126 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:11.787090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9fd66395-7ab1-4620-b80c-94e506e1e78a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-4qvjs\" (UID: \"9fd66395-7ab1-4620-b80c-94e506e1e78a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:11.787310 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:11.787247    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:26:11.787373 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:11.787316    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fd66395-7ab1-4620-b80c-94e506e1e78a-tls-certificates podName:9fd66395-7ab1-4620-b80c-94e506e1e78a nodeName:}" failed. No retries permitted until 2026-07-27 19:26:12.287296057 +0000 UTC m=+143.158482684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9fd66395-7ab1-4620-b80c-94e506e1e78a-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-4qvjs" (UID: "9fd66395-7ab1-4620-b80c-94e506e1e78a") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:26:12.139219 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.139179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm" event={"ID":"cf4d9e1a-4b71-4e48-922a-641b6db539b0","Type":"ContainerStarted","Data":"2ad89c62eae5a8e03dcceddfccada01aa79fe40c0d9228fcb0cf99d651c9c235"}
Jul 27 19:26:12.161580 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.161531    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-dndtm" podStartSLOduration=33.765764931 podStartE2EDuration="36.161515919s" totalImagesPullingTime="2.395750988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:12.160930132 +0000 UTC m=+143.032116784" watchObservedRunningTime="2026-07-27 19:26:12.161515919 +0000 UTC m=+143.032702636"
Jul 27 19:26:12.291622 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.291594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9fd66395-7ab1-4620-b80c-94e506e1e78a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-4qvjs\" (UID: \"9fd66395-7ab1-4620-b80c-94e506e1e78a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:12.291760 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.291636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:12.294234 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.294210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9w9xz\" (UID: \"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\") " pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:12.294234 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.294223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9fd66395-7ab1-4620-b80c-94e506e1e78a-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-4qvjs\" (UID: \"9fd66395-7ab1-4620-b80c-94e506e1e78a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:12.468024 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.467973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:12.546889 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.546824    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kpwnj\""
Jul 27 19:26:12.554287 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.554269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:12.619038 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.619016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"]
Jul 27 19:26:12.621368 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:26:12.621342    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd66395_7ab1_4620_b80c_94e506e1e78a.slice/crio-f74dea32d46cd171b4bf95b8d8cc98c218ef94f064024d7fb8be51e7cd3ce072 WatchSource:0}: Error finding container f74dea32d46cd171b4bf95b8d8cc98c218ef94f064024d7fb8be51e7cd3ce072: Status 404 returned error can't find the container with id f74dea32d46cd171b4bf95b8d8cc98c218ef94f064024d7fb8be51e7cd3ce072
Jul 27 19:26:12.686862 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:12.686683    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9w9xz"]
Jul 27 19:26:12.689345 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:26:12.689319    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ef8d14_3a52_4ea7_a73a_a5fafdb0ac7e.slice/crio-63050ec6d2910a773326deadb19e52bfdcb7232c550968eef28591b9714cfafe WatchSource:0}: Error finding container 63050ec6d2910a773326deadb19e52bfdcb7232c550968eef28591b9714cfafe: Status 404 returned error can't find the container with id 63050ec6d2910a773326deadb19e52bfdcb7232c550968eef28591b9714cfafe
Jul 27 19:26:13.147409 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:13.147344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9w9xz" event={"ID":"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e","Type":"ContainerStarted","Data":"63050ec6d2910a773326deadb19e52bfdcb7232c550968eef28591b9714cfafe"}
Jul 27 19:26:13.150542 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:13.150514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs" event={"ID":"9fd66395-7ab1-4620-b80c-94e506e1e78a","Type":"ContainerStarted","Data":"f74dea32d46cd171b4bf95b8d8cc98c218ef94f064024d7fb8be51e7cd3ce072"}
Jul 27 19:26:14.156057 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.155969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs" event={"ID":"9fd66395-7ab1-4620-b80c-94e506e1e78a","Type":"ContainerStarted","Data":"af2f374eb3cb94e5acd7524633f3576d65355c9044278515356723a572527915"}
Jul 27 19:26:14.156521 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.156154    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:14.161460 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.161436    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs"
Jul 27 19:26:14.178383 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.178325    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-4qvjs" podStartSLOduration=1.935292895 podStartE2EDuration="3.178310695s" totalImagesPullingTime="1.2430178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:14.176721318 +0000 UTC m=+145.047907969" watchObservedRunningTime="2026-07-27 19:26:14.178310695 +0000 UTC m=+145.049497343"
Jul 27 19:26:14.679807 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.679778    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"]
Jul 27 19:26:14.683207 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.683181    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.688121 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.687656    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 19:26:14.688121 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.687689    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:26:14.688121 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.687702    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vglsr\""
Jul 27 19:26:14.688121 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.687887    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:26:14.688121 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.687929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:26:14.688481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.688146    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 19:26:14.695605 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.695579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"]
Jul 27 19:26:14.819400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.819365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.819570 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.819426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6hjc\" (UniqueName: \"kubernetes.io/projected/cdb3e6de-b7f1-4520-b94f-127fa6c49003-kube-api-access-s6hjc\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.819570 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.819498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.819570 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.819561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdb3e6de-b7f1-4520-b94f-127fa6c49003-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.921009 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.920978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.921169 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.921026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6hjc\" (UniqueName: \"kubernetes.io/projected/cdb3e6de-b7f1-4520-b94f-127fa6c49003-kube-api-access-s6hjc\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.921169 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:14.921125    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 27 19:26:14.921264 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:14.921189    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-tls podName:cdb3e6de-b7f1-4520-b94f-127fa6c49003 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:15.421169478 +0000 UTC m=+146.292356120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-6q6rz" (UID: "cdb3e6de-b7f1-4520-b94f-127fa6c49003") : secret "prometheus-operator-tls" not found
Jul 27 19:26:14.921264 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.921210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.921365 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.921262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdb3e6de-b7f1-4520-b94f-127fa6c49003-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.921863 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.921836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdb3e6de-b7f1-4520-b94f-127fa6c49003-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.923861 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.923837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:14.934891 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:14.934827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6hjc\" (UniqueName: \"kubernetes.io/projected/cdb3e6de-b7f1-4520-b94f-127fa6c49003-kube-api-access-s6hjc\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:15.427276 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:15.427231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:15.430098 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:15.430057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cdb3e6de-b7f1-4520-b94f-127fa6c49003-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6q6rz\" (UID: \"cdb3e6de-b7f1-4520-b94f-127fa6c49003\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:15.593847 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:15.593817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:17.758784 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:17.758754    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:17.758784 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88" Netns:"/var/run/netns/93ec149f-5389-4d9f-8881-217ba7a8c097" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:17.758784 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:17.758784 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:17.758816    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88" Netns:"/var/run/netns/93ec149f-5389-4d9f-8881-217ba7a8c097" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:17.758846    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88" Netns:"/var/run/netns/93ec149f-5389-4d9f-8881-217ba7a8c097" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:17.759153 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:17.759372 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:17.758938    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88\\\" Netns:\\\"/var/run/netns/93ec149f-5389-4d9f-8881-217ba7a8c097\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=364df0d92354228dab5db672546b359584b9a6b3584258b218dd5434ba71bc88;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podUID="cdb3e6de-b7f1-4520-b94f-127fa6c49003"
Jul 27 19:26:18.172303 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:18.172271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:18.172520 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:18.172489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9w9xz" event={"ID":"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e","Type":"ContainerStarted","Data":"497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e"}
Jul 27 19:26:18.172639 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:18.172625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:18.456393 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:18.456349    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:18.456393 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926" Netns:"/var/run/netns/36e8b6a3-411a-4fc0-9267-13086371020c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:18.456393 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:18.456393 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:18.456412    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926" Netns:"/var/run/netns/36e8b6a3-411a-4fc0-9267-13086371020c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:18.456438    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926" Netns:"/var/run/netns/36e8b6a3-411a-4fc0-9267-13086371020c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:18.456757 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:18.457171 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:18.456536    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926\\\" Netns:\\\"/var/run/netns/36e8b6a3-411a-4fc0-9267-13086371020c\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=23352229ff9970a3a6e07243cb4e72626d18b3a3c0a1f066450e5f49e6e50926;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podUID="cdb3e6de-b7f1-4520-b94f-127fa6c49003"
Jul 27 19:26:21.184420 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:21.184384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9w9xz" event={"ID":"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e","Type":"ContainerStarted","Data":"b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec"}
Jul 27 19:26:22.570806 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:22.570656    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:22.596016 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:22.595833    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:22.623186 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:22.623075    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:22.644710 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:22.644600    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:22.665863 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:22.665748    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:22Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:22.665863 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:22.665858    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:25.199139 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:25.199097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9w9xz" event={"ID":"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e","Type":"ContainerStarted","Data":"634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a"}
Jul 27 19:26:25.216163 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:25.216085    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:27.551182 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:27.551135    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf" podUID="9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"
Jul 27 19:26:27.559266 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:27.559232    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x2r4v" podUID="6064e7eb-a738-4115-8229-c66c32af6baf"
Jul 27 19:26:28.208617 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:28.208587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:28.208793 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:28.208589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:29.602865 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:29.602800    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:32.470544 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.470512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:32.470905 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.470555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:32.473176 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.473147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6064e7eb-a738-4115-8229-c66c32af6baf-metrics-tls\") pod \"dns-default-x2r4v\" (UID: \"6064e7eb-a738-4115-8229-c66c32af6baf\") " pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:32.473307 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.473247    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"image-registry-7fc755c8cf-4b5kf\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") " pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:32.714443 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.714404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mlfrd\""
Jul 27 19:26:32.714443 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.714416    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ksszw\""
Jul 27 19:26:32.720214 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.720179    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:32.720359 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:32.720215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:32.886913 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:32.886800    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:32.907274 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:32.907099    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:32.929697 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:32.929599    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:32.960738 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:32.960578    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:32.996232 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:32.996054    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:32Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:32.996232 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:32.996236    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:33.001979 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.001916    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:33.001979 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75" Netns:"/var/run/netns/ab829e5f-4c27-403b-a2fd-95ba92d1d251" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.001979 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.001979 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.002008    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75" Netns:"/var/run/netns/ab829e5f-4c27-403b-a2fd-95ba92d1d251" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.002032    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75" Netns:"/var/run/netns/ab829e5f-4c27-403b-a2fd-95ba92d1d251" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.002146 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:33.002390 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.002117    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75): error adding pod openshift-dns_dns-default-x2r4v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75\\\" Netns:\\\"/var/run/netns/ab829e5f-4c27-403b-a2fd-95ba92d1d251\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=44eb7584943692015fd80d1ab69f545bb8ca1b4e6f0184f910810a42ee38eb75;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-x2r4v" podUID="6064e7eb-a738-4115-8229-c66c32af6baf"
Jul 27 19:26:33.006875 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.006835    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:33.006875 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3" Netns:"/var/run/netns/740957b5-7a49-4908-9862-0dabfd8a8361" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.006875 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.006875 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.006894    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3" Netns:"/var/run/netns/740957b5-7a49-4908-9862-0dabfd8a8361" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.006911    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3" Netns:"/var/run/netns/740957b5-7a49-4908-9862-0dabfd8a8361" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:33.007049 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.006986    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3\\\" Netns:\\\"/var/run/netns/740957b5-7a49-4908-9862-0dabfd8a8361\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=f46fc537556bd97507bf13d3ecfdeacf72fee746412b76772d942ebff31931f3;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf" podUID="9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"
Jul 27 19:26:33.580643 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:33.580606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:33.581035 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:33.580877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:33.824025 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.823981    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:33.824025 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77" Netns:"/var/run/netns/f334352e-11fc-4923-b7db-b83971b4d190" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.824025 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.824025 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.824046    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77" Netns:"/var/run/netns/f334352e-11fc-4923-b7db-b83971b4d190" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.824066    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77" Netns:"/var/run/netns/f334352e-11fc-4923-b7db-b83971b4d190" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:33.824332 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:33.824145    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77\\\" Netns:\\\"/var/run/netns/f334352e-11fc-4923-b7db-b83971b4d190\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=aa6e8b302ff4240040a439e13dbe02c708079258cf67e1468fa90cba40992d77;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podUID="cdb3e6de-b7f1-4520-b94f-127fa6c49003"
Jul 27 19:26:39.604192 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:39.604126    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:43.293058 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:43.292923    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.311197 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:43.311076    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.327573 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:43.327456    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.345055 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:43.344936    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.361193 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:43.361086    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:43.361193 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:43.361182    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:44.581144 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:44.581116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:44.581546 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:44.581281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:44.581546 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:44.581382    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:44.581546 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:44.581518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:44.856000 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.855909    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:44.856000 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143" Netns:"/var/run/netns/2aeda67a-be15-47a9-bfcf-84523f627ee7" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:44.856000 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:44.856000 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.856128    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143" Netns:"/var/run/netns/2aeda67a-be15-47a9-bfcf-84523f627ee7" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.856160    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143" Netns:"/var/run/netns/2aeda67a-be15-47a9-bfcf-84523f627ee7" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:44.856285 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:44.856603 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.856257    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143\\\" Netns:\\\"/var/run/netns/2aeda67a-be15-47a9-bfcf-84523f627ee7\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=ac5018027001ada190c639b0057a133466492ab3d5fa681cbc2059ac95866143;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podUID="cdb3e6de-b7f1-4520-b94f-127fa6c49003"
Jul 27 19:26:44.861905 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.861874    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:44.861905 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f" Netns:"/var/run/netns/15c8e8dd-33c4-471a-b50e-9437ed0a4552" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:44.861905 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:44.861905 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.861920    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f" Netns:"/var/run/netns/15c8e8dd-33c4-471a-b50e-9437ed0a4552" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.861938    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f" Netns:"/var/run/netns/15c8e8dd-33c4-471a-b50e-9437ed0a4552" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:44.862076 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:44.862037    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f): error adding pod openshift-dns_dns-default-x2r4v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f\\\" Netns:\\\"/var/run/netns/15c8e8dd-33c4-471a-b50e-9437ed0a4552\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=af5aeb6341697846ac0165074b7ce0923dff88cfcf3addc794814f020f67544f;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-x2r4v" podUID="6064e7eb-a738-4115-8229-c66c32af6baf"
Jul 27 19:26:46.580554 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:46.580506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:46.581093 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:46.580902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:46.822297 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:46.822260    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:46.822297 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b" Netns:"/var/run/netns/21bddcd5-3737-4d62-840a-a68f2c6f6af8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:46.822297 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:46.822297 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:46.822319    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b" Netns:"/var/run/netns/21bddcd5-3737-4d62-840a-a68f2c6f6af8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:46.822341    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b" Netns:"/var/run/netns/21bddcd5-3737-4d62-840a-a68f2c6f6af8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:46.822468 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:46.822410    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b\\\" Netns:\\\"/var/run/netns/21bddcd5-3737-4d62-840a-a68f2c6f6af8\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=5e2bf912e34a7e561b6948ad49eaf9521406f786b89f0185b745749fa4d6a07b;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf" podUID="9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"
Jul 27 19:26:49.608342 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:49.608266    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:53.448259 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:53.448129    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.469228 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:53.469091    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.489196 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:53.489071    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.510886 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:53.510769    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.529619 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:53.529487    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:53Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:26:53.529619 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:53.529614    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:26:56.581046 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:56.581008    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:56.581432 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:56.581270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:56.856387 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:56.856349    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:56.856387 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0" Netns:"/var/run/netns/70abc617-5244-4623-bc22-e6d9e5b8d06f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:56.856387 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:56.856387 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:56.856409    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0" Netns:"/var/run/netns/70abc617-5244-4623-bc22-e6d9e5b8d06f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:56.856428    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0" Netns:"/var/run/netns/70abc617-5244-4623-bc22-e6d9e5b8d06f" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:26:56.856617 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:56.856494    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0): error adding pod openshift-dns_dns-default-x2r4v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0\\\" Netns:\\\"/var/run/netns/70abc617-5244-4623-bc22-e6d9e5b8d06f\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=73575812d06f636c22e870a8e48b321d4303ca19e454113120c01260896598c0;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-x2r4v" podUID="6064e7eb-a738-4115-8229-c66c32af6baf"
Jul 27 19:26:59.582447 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:59.582416    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:59.582903 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:59.582602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:59.582903 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:59.582752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:59.582903 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:26:59.582874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:59.603481 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.603391    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.855496    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01" Netns:"/var/run/netns/86ce6314-cc7f-4a53-82e9-fc44bf3c0fbb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.855551    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01" Netns:"/var/run/netns/86ce6314-cc7f-4a53-82e9-fc44bf3c0fbb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.855569    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01" Netns:"/var/run/netns/86ce6314-cc7f-4a53-82e9-fc44bf3c0fbb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:26:59.855747 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.855646    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01\\\" Netns:\\\"/var/run/netns/86ce6314-cc7f-4a53-82e9-fc44bf3c0fbb\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c600651527fb1d1e6ff1b9fc323ee82053625fa58dacf21d03bb698f36788d01;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf" podUID="9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"
Jul 27 19:26:59.881663 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.881626    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:26:59.881663 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c" Netns:"/var/run/netns/b25f8f36-ae10-418c-a520-309cc415f16a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:59.881663 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:59.881663 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.881683    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c" Netns:"/var/run/netns/b25f8f36-ae10-418c-a520-309cc415f16a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.881704    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c" Netns:"/var/run/netns/b25f8f36-ae10-418c-a520-309cc415f16a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:26:59.881817 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:26:59.881773    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c\\\" Netns:\\\"/var/run/netns/b25f8f36-ae10-418c-a520-309cc415f16a\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=99e258b0b1711b50298570cfa7987a3fd9602e4c50baa5c45b167bb73ff5919c;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podUID="cdb3e6de-b7f1-4520-b94f-127fa6c49003"
Jul 27 19:27:03.574501 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:03.574378    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:03.591960 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:03.591822    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:03.610786 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:03.610670    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:03.627248 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:03.627130    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:03.644398 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:03.644283    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:03.644398 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:03.644390    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:05.327999 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:05.327941    2563 generic.go:356] "Generic (PLEG): container finished" podID="9b00a821-342c-461d-9c28-202f8ff3bf0e" containerID="80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc" exitCode=0
Jul 27 19:27:05.327999 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:05.327998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-xnbmk" event={"ID":"9b00a821-342c-461d-9c28-202f8ff3bf0e","Type":"ContainerDied","Data":"80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc"}
Jul 27 19:27:05.328527 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:05.328314    2563 scope.go:117] "RemoveContainer" containerID="80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc"
Jul 27 19:27:05.344727 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:05.344672    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b00a821-342c-461d-9c28-202f8ff3bf0e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"message\\\":\\\"containers with unready status: [insights-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"},\\\"containerID\\\":\\\"cri-o://80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000350000],\\\"uid\\\":1000350000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-66bc2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-xnbmk\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:27:05.363111 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:05.363050    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:27:06.333524 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:06.333482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-xnbmk" event={"ID":"9b00a821-342c-461d-9c28-202f8ff3bf0e","Type":"ContainerStarted","Data":"792b0b1c11790c7282b5b046d4a6f52862c988f91fc937b315b2ec7a125c7a93"}
Jul 27 19:27:06.353390 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:06.353333    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b00a821-342c-461d-9c28-202f8ff3bf0e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"},\\\"containerID\\\":\\\"cri-o://792b0b1c11790c7282b5b046d4a6f52862c988f91fc937b315b2ec7a125c7a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:38Z\\\"}},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000350000],\\\"uid\\\":1000350000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-66bc2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-xnbmk\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:27:06.369842 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:06.369772    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:27:07.324666 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:07.324641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-dndtm_cf4d9e1a-4b71-4e48-922a-641b6db539b0/networking-console-plugin/0.log"
Jul 27 19:27:08.581163 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:08.581122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:08.581525 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:08.581504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:08.811267 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:08.811220    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:08.811267 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15" Netns:"/var/run/netns/52c13d79-9e52-4364-89b7-3454949a7ce8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:08.811267 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:08.811267 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:08.811293    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15" Netns:"/var/run/netns/52c13d79-9e52-4364-89b7-3454949a7ce8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:08.811315    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15" Netns:"/var/run/netns/52c13d79-9e52-4364-89b7-3454949a7ce8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:08.811420 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:08.811802 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:08.811390    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15): error adding pod openshift-dns_dns-default-x2r4v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15\\\" Netns:\\\"/var/run/netns/52c13d79-9e52-4364-89b7-3454949a7ce8\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=06cc1b4760b76a554825fde21dba5a15b68b888609f79ae5bae9aed19ae16c15;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-x2r4v" podUID="6064e7eb-a738-4115-8229-c66c32af6baf"
Jul 27 19:27:09.597856 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:09.597800    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b00a821-342c-461d-9c28-202f8ff3bf0e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"},\\\"containerID\\\":\\\"cri-o://792b0b1c11790c7282b5b046d4a6f52862c988f91fc937b315b2ec7a125c7a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:38Z\\\"}},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000350000],\\\"uid\\\":1000350000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-66bc2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-xnbmk\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:27:09.614086 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:09.614014    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:27:09.724396 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:09.724362    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vkzq_44654a09-d2f9-40d1-a976-c6364d2421c3/dns-node-resolver/0.log"
Jul 27 19:27:11.325032 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:11.324978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfvd_e4d328d4-903c-4c73-8afa-f3281045dcc1/node-ca/0.log"
Jul 27 19:27:11.581015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:11.580914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:11.581236 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:11.581223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:11.726172 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:11.726141    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-6bpqk_194825d3-9cec-4adc-ab02-acda46dd735d/csi-driver/0.log"
Jul 27 19:27:11.832165 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:11.832128    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:11.832165 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145" Netns:"/var/run/netns/b0f130c8-fa57-4702-883c-f8dba111b964" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:11.832165 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:11.832165 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:11.832187    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145" Netns:"/var/run/netns/b0f130c8-fa57-4702-883c-f8dba111b964" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:11.832204    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145" Netns:"/var/run/netns/b0f130c8-fa57-4702-883c-f8dba111b964" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:11.832342 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:11.832794 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:11.832731    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145\\\" Netns:\\\"/var/run/netns/b0f130c8-fa57-4702-883c-f8dba111b964\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=e25ecf9824767a73e70d4185a6843e2804aebec6cbe2ecb632f6f303c73c8145;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf" podUID="9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"
Jul 27 19:27:11.925081 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:11.925051    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-6bpqk_194825d3-9cec-4adc-ab02-acda46dd735d/csi-node-driver-registrar/0.log"
Jul 27 19:27:12.125378 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:12.125297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-6bpqk_194825d3-9cec-4adc-ab02-acda46dd735d/csi-liveness-probe/0.log"
Jul 27 19:27:13.580909 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:13.580868    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:13.581382 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:13.581156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:14.275206 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:14.275087    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:13Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:13Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:13Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:13Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:14.394028 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:14.393989    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:14.394028 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440" Netns:"/var/run/netns/789e6ea0-8138-4071-8670-416d5de9330a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:14.394028 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:14.394028 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:14.394055    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440" Netns:"/var/run/netns/789e6ea0-8138-4071-8670-416d5de9330a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:14.394080    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440" Netns:"/var/run/netns/789e6ea0-8138-4071-8670-416d5de9330a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:14.394264 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:14.394178    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440\\\" Netns:\\\"/var/run/netns/789e6ea0-8138-4071-8670-416d5de9330a\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=600eebb58fe5dee6eafa2fea9e8696c5f44e17a9ae708104ef7a8637f2745440;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podUID="cdb3e6de-b7f1-4520-b94f-127fa6c49003"
Jul 27 19:27:14.932908 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:14.932777    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.017551 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:15.017431    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:14Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.039433 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:15.039315    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.058157 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:15.058027    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:15.058157 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:15.058147    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:19.602231 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:19.602169    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b00a821-342c-461d-9c28-202f8ff3bf0e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"},\\\"containerID\\\":\\\"cri-o://792b0b1c11790c7282b5b046d4a6f52862c988f91fc937b315b2ec7a125c7a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:38Z\\\"}},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000350000],\\\"uid\\\":1000350000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-66bc2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-xnbmk\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:27:19.619913 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:19.619838    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:27:20.581099 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:20.581052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:20.581347 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:20.581336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:20.827243 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:20.827203    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:20.827243 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81" Netns:"/var/run/netns/2991636a-ace6-4582-9f99-4b59e98db4ff" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:20.827243 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:20.827243 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:20.827270    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81" Netns:"/var/run/netns/2991636a-ace6-4582-9f99-4b59e98db4ff" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:20.827291    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81): error adding pod openshift-dns_dns-default-x2r4v to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81" Netns:"/var/run/netns/2991636a-ace6-4582-9f99-4b59e98db4ff" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf" Path:"" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:20.827683 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:20.827361    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"dns-default-x2r4v_openshift-dns(6064e7eb-a738-4115-8229-c66c32af6baf)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_dns-default-x2r4v_openshift-dns_6064e7eb-a738-4115-8229-c66c32af6baf_0(7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81): error adding pod openshift-dns_dns-default-x2r4v to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81\\\" Netns:\\\"/var/run/netns/2991636a-ace6-4582-9f99-4b59e98db4ff\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-dns;K8S_POD_NAME=dns-default-x2r4v;K8S_POD_INFRA_CONTAINER_ID=7c4854a3adc0a4db89969f811c670eeae006bc2992642927189f11e8c0ffec81;K8S_POD_UID=6064e7eb-a738-4115-8229-c66c32af6baf\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-dns/dns-default-x2r4v] networking: Multus: [openshift-dns/dns-default-x2r4v/6064e7eb-a738-4115-8229-c66c32af6baf]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod dns-default-x2r4v in out of cluster comm: SetNetworkStatus: failed to update the pod dns-default-x2r4v in out of cluster comm: status update failed for pod openshift-dns/dns-default-x2r4v: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-dns/dns-default-x2r4v" podUID="6064e7eb-a738-4115-8229-c66c32af6baf"
Jul 27 19:27:23.580633 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:23.580598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:23.581043 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:23.580881    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:23.819380 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:23.819345    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:23.819380 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f" Netns:"/var/run/netns/d76321d1-a7b0-4322-b05d-291e637a3cfd" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:23.819380 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:23.819380 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:23.819404    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f" Netns:"/var/run/netns/d76321d1-a7b0-4322-b05d-291e637a3cfd" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:23.819421    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f" Netns:"/var/run/netns/d76321d1-a7b0-4322-b05d-291e637a3cfd" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" Path:"" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:23.819541 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:23.819487    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"image-registry-7fc755c8cf-4b5kf_openshift-image-registry(9c3b7795-5eb6-4224-bf5c-45db0dc6b17d)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_image-registry-7fc755c8cf-4b5kf_openshift-image-registry_9c3b7795-5eb6-4224-bf5c-45db0dc6b17d_0(c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f): error adding pod openshift-image-registry_image-registry-7fc755c8cf-4b5kf to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f\\\" Netns:\\\"/var/run/netns/d76321d1-a7b0-4322-b05d-291e637a3cfd\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-image-registry;K8S_POD_NAME=image-registry-7fc755c8cf-4b5kf;K8S_POD_INFRA_CONTAINER_ID=c59eb86eba9ed5456cf0a2c8de4ea5d02a06ad0192e5167bd4ee862589cb0c5f;K8S_POD_UID=9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-image-registry/image-registry-7fc755c8cf-4b5kf] networking: Multus: [openshift-image-registry/image-registry-7fc755c8cf-4b5kf/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: SetNetworkStatus: failed to update the pod image-registry-7fc755c8cf-4b5kf in out of cluster comm: status update failed for pod openshift-image-registry/image-registry-7fc755c8cf-4b5kf: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf" podUID="9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"
Jul 27 19:27:25.161558 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:25.161437    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.183935 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:25.183823    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.203632 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:25.203506    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.222181 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:25.222065    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.242421 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:25.242306    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:25Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:293fa839fb89fb9cbf1ce2af15b9a77fd74330235b9cfb7c52dd9036aeaa9460\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:db45730f38384cb9f01ddcadeb44c84f374d2f7247d6bac02763ad686d826fbc\\\"],\\\"sizeBytes\\\":576024653},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:4a060b462bf74148809ea5f1bb39ace87d7a251fdb2d387f13508269115c0031\\\",\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\"],\\\"sizeBytes\\\":496206599},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0b0cacd583df5a8b474e50ea6e4781dcc25c98a58c4003f8f4d2376d2e06d3e4\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7098150c7700e387c4b2b8a27c1f2f20e8a5cc53f34664fb04e53045726b32ac\\\"],\\\"sizeBytes\\\":456384232},{\\\"names\\\":[\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:f5b83335633379dc80042ac69074b3c2abde3d69f63b737c2de0dda6c7b7c77c\\\",\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\"],\\\"sizeBytes\\\":436864195},{\\\"names\\\":[\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:10add13245db4206ba7f6b6e28913818393b8ee44504955cee6d0f4ebf1ec628\\\",\\\"registry.redhat.io/multicluster-engine/multicloud-manager-rhel9@sha256:db1f6513b062ed463e30189bd2919672f91bae2b6a29b9f217f7d76e4b5363cc\\\"],\\\"sizeBytes\\\":402350115},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3e8baa2658dad94f5ac6ec283c79202450a40a19107b35205491bdced10517aa\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b12683cf9c88863a8143e16207d8db92faef5df2d2e082879b78cc67d123c7f\\\"],\\\"sizeBytes\\\":386904411},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3ccf26804e4c2892dc703d277ba93d85e4745c96be2e488c77e6c68bd899f82b\\\"],\\\"sizeBytes\\\":337921863},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\"],\\\"sizeBytes\\\":333477993},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:aaa406e189db0611e77288dcd04e922263ad11392a640bf5edb93d6a527d4161\\\",\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\"],\\\"sizeBytes\\\":258221534},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1bbb1d9aa57ab0b1920e794cfc839022f702b58d614276c25c41a98c877ea535\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e88ce5c874f863471f5a463284f695b9754b4da18271049339c1f40d050e94a\\\"],\\\"sizeBytes\\\":252983383},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d896626ef70b135e497f1e49009b9e41e77f967256f0fdbb458e483f5a3dfdc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eefd9d1ae328ca73453455a35847ce0479d9e1f71503d34a31005a23b3a0e997\\\"],\\\"sizeBytes\\\":250954080},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf80bb0a3a5310628b75758a1de08f2d1755d95f964fc76b3dcaa70e977065e1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f8a65e0d6df473726283d682deab42c9683772bd24f46813653e73cab18a6d59\\\"],\\\"sizeBytes\\\":248879212},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-130-91.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/node?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused"
Jul 27 19:27:25.242421 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:25.242413    2563 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 27 19:27:28.581296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:28.581248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:28.581690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:28.581528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:28.839000 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:28.838935    2563 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 27 19:27:28.839000 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661" Netns:"/var/run/netns/efefd21a-493f-4d6c-9532-9878ca4527fb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:28.839000 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:28.839000 ip-10-0-130-91 kubenswrapper[2563]:  >
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:28.839018    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661" Netns:"/var/run/netns/efefd21a-493f-4d6c-9532-9878ca4527fb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:28.839039    2563 kuberuntime_manager.go:1353] "CreatePodSandbox for pod failed" err=<
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661" Netns:"/var/run/netns/efefd21a-493f-4d6c-9532-9878ca4527fb" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003" Path:"" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook "pod.network-node-identity.openshift.io": failed to call webhook: Post "https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s": dial tcp 172.30.7.110:9743: connect: connection refused
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]:  > pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:28.839186 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:28.839113    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"prometheus-operator-84d69f794d-6q6rz_openshift-monitoring(cdb3e6de-b7f1-4520-b94f-127fa6c49003)\\\": rpc error: code = Unknown desc = failed to create pod network sandbox k8s_prometheus-operator-84d69f794d-6q6rz_openshift-monitoring_cdb3e6de-b7f1-4520-b94f-127fa6c49003_0(f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661): error adding pod openshift-monitoring_prometheus-operator-84d69f794d-6q6rz to CNI network \\\"multus-cni-network\\\": plugin type=\\\"multus-shim\\\" name=\\\"multus-cni-network\\\" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:\\\"f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661\\\" Netns:\\\"/var/run/netns/efefd21a-493f-4d6c-9532-9878ca4527fb\\\" IfName:\\\"eth0\\\" Args:\\\"IgnoreUnknown=1;K8S_POD_NAMESPACE=openshift-monitoring;K8S_POD_NAME=prometheus-operator-84d69f794d-6q6rz;K8S_POD_INFRA_CONTAINER_ID=f7c1372c38e737a813a3d1234b1038bea16ba47074dc269b9a99a9092254e661;K8S_POD_UID=cdb3e6de-b7f1-4520-b94f-127fa6c49003\\\" Path:\\\"\\\" ERRORED: error configuring pod [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz] networking: Multus: [openshift-monitoring/prometheus-operator-84d69f794d-6q6rz/cdb3e6de-b7f1-4520-b94f-127fa6c49003]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: SetNetworkStatus: failed to update the pod prometheus-operator-84d69f794d-6q6rz in out of cluster comm: status update failed for pod openshift-monitoring/prometheus-operator-84d69f794d-6q6rz: Internal error occurred: failed calling webhook \\\"pod.network-node-identity.openshift.io\\\": failed to call webhook: Post \\\"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\\\": dial tcp 172.30.7.110:9743: connect: connection refused\\n': StdinData: {\\\"auxiliaryCNIChainName\\\":\\\"vendor-cni-chain\\\",\\\"binDir\\\":\\\"/var/lib/cni/bin\\\",\\\"clusterNetwork\\\":\\\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\\\",\\\"cniVersion\\\":\\\"0.3.1\\\",\\\"daemonSocketDir\\\":\\\"/run/multus/socket\\\",\\\"globalNamespaces\\\":\\\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\\\",\\\"logLevel\\\":\\\"verbose\\\",\\\"logToStderr\\\":true,\\\"name\\\":\\\"multus-cni-network\\\",\\\"namespaceIsolation\\\":true,\\\"type\\\":\\\"multus-shim\\\"}\"" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podUID="cdb3e6de-b7f1-4520-b94f-127fa6c49003"
Jul 27 19:27:29.602819 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:29.602764    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9b00a821-342c-461d-9c28-202f8ff3bf0e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:06Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"},\\\"containerID\\\":\\\"cri-o://792b0b1c11790c7282b5b046d4a6f52862c988f91fc937b315b2ec7a125c7a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7708b5cca3725104a4aade8659d376b2d4ddaf69a7ba4349a2b961f9b790b517\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06462ab012ea7df65baa4ef8b2256f8854f4dfe681fb35f138a41cc1338eabaf\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://80edfc19afc23309428fdb9b338e7eb3c9c8180bf90bead9d3ea0faafafba2fc\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:27:04Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:25:38Z\\\"}},\\\"name\\\":\\\"insights-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"54Mi\\\"}},\\\"restartCount\\\":1,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:27:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000350000],\\\"uid\\\":1000350000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/var/lib/insights-operator\\\",\\\"name\\\":\\\"snapshots\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/trusted-ca-bundle\\\",\\\"name\\\":\\\"trusted-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/configmaps/service-ca-bundle\\\",\\\"name\\\":\\\"service-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"serving-cert\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-66bc2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-insights\"/\"insights-operator-5885fdb759-xnbmk\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-operator-5885fdb759-xnbmk"
Jul 27 19:27:29.624244 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:29.624174    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:25Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b5dd8cdbcec46897e5afeaf35144eab3897cc971718bed7dbc66d93d1d5940ec\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-exporter@sha256:49ac9e2d3ec12a66e92f72969141d01c947d7918fa193c0e54876dfee873711d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"exporter\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:21Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://634e951a3fdc4d7fdc2f3787746d9980da0fc9ff90fc9321547de3fbea71759a\\\",\\\"image\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-insights-runtime-extractor@sha256:49ed43f89842b75a35ac5fb95262a12f5eb9408a2080b06a34665afe9c21b3d7\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"extractor\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/crio.sock\\\",\\\"name\\\":\\\"crio-socket\\\"},{\\\"mountPath\\\":\\\"/data\\\",\\\"name\\\":\\\"data-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://497d2fce49d10075f37d5b54063240487afe3f6e6390c02a6a6baa0442ef1b4e\\\",\\\"image\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\",\\\"imageID\\\":\\\"quay.io/openshift/origin-kube-rbac-proxy@sha256:955a4c242f8bb3cdfdf2c43e8c852cdd1689a1c76437f76967f5b23c3382126d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:17Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"insights-runtime-extractor-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"kube-rbac-proxy-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lwjx9\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.132.0.12\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.132.0.12\\\"}]}}\" for pod \"openshift-insights\"/\"insights-runtime-extractor-9w9xz\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-69888ee1-6e4e-49ad-86b3-871be4aaf8b0.svc:9743/pod?timeout=10s\": dial tcp 172.30.7.110:9743: connect: connection refused" pod="openshift-insights/insights-runtime-extractor-9w9xz"
Jul 27 19:27:33.580878 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:33.580832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:33.581288 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:33.581178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:33.714180 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:33.714072    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2r4v"]
Jul 27 19:27:33.716476 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:33.716452    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6064e7eb_a738_4115_8229_c66c32af6baf.slice/crio-42dad6d121c47b8dadda7fb004f15a53d1f14f88b51bc34363c149ffa5481d64 WatchSource:0}: Error finding container 42dad6d121c47b8dadda7fb004f15a53d1f14f88b51bc34363c149ffa5481d64: Status 404 returned error can't find the container with id 42dad6d121c47b8dadda7fb004f15a53d1f14f88b51bc34363c149ffa5481d64
Jul 27 19:27:34.426116 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.426073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2r4v" event={"ID":"6064e7eb-a738-4115-8229-c66c32af6baf","Type":"ContainerStarted","Data":"42dad6d121c47b8dadda7fb004f15a53d1f14f88b51bc34363c149ffa5481d64"}
Jul 27 19:27:34.588802 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.588702    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fc755c8cf-4b5kf"]
Jul 27 19:27:34.589265 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.588836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:34.596404 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.596381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:34.687186 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.687074    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9w9xz" podStartSLOduration=102.992085576 podStartE2EDuration="1m54.687052481s" totalImagesPullingTime="11.694966905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:34.681099968 +0000 UTC m=+225.552286631" watchObservedRunningTime="2026-07-27 19:27:34.687052481 +0000 UTC m=+225.558239132"
Jul 27 19:27:34.720658 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.720614    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsdhs\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-kube-api-access-qsdhs\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.720658 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.720655    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-image-registry-private-configuration\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.720905 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.720685    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-bound-sa-token\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.720905 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.720717    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-certificates\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.720905 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.720744    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-ca-trust-extracted\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.720905 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.720773    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-installation-pull-secrets\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.721161 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.721128    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:27:34.721219 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.721175    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-trusted-ca\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.721275 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.721240    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") pod \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\" (UID: \"9c3b7795-5eb6-4224-bf5c-45db0dc6b17d\") "
Jul 27 19:27:34.721547 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.721500    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:27:34.721671 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.721612    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:27:34.721748 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.721667    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-certificates\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:34.721748 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.721687    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-ca-trust-extracted\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:34.725106 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.725058    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:27:34.725106 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.725074    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:27:34.725400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.725238    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-kube-api-access-qsdhs" (OuterVolumeSpecName: "kube-api-access-qsdhs") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "kube-api-access-qsdhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:27:34.725400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.725323    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:27:34.727072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.727050    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" (UID: "9c3b7795-5eb6-4224-bf5c-45db0dc6b17d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:27:34.822811 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.822775    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-trusted-ca\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:34.822811 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.822804    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-registry-tls\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:34.822811 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.822817    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsdhs\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-kube-api-access-qsdhs\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:34.823069 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.822831    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-image-registry-private-configuration\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:34.823069 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.822844    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-bound-sa-token\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:34.823069 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:34.822855    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d-installation-pull-secrets\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:27:35.429836 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:35.429804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc755c8cf-4b5kf"
Jul 27 19:27:35.480962 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:35.480908    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fc755c8cf-4b5kf"]
Jul 27 19:27:35.488910 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:35.488877    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fc755c8cf-4b5kf"]
Jul 27 19:27:35.585791 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:35.585599    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3b7795-5eb6-4224-bf5c-45db0dc6b17d" path="/var/lib/kubelet/pods/9c3b7795-5eb6-4224-bf5c-45db0dc6b17d/volumes"
Jul 27 19:27:36.434189 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:36.434154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2r4v" event={"ID":"6064e7eb-a738-4115-8229-c66c32af6baf","Type":"ContainerStarted","Data":"4214d82a57d589bf1922bb89e72dd4a61f7d0641e84b78085e03244e5298e4a5"}
Jul 27 19:27:36.434661 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:36.434204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2r4v" event={"ID":"6064e7eb-a738-4115-8229-c66c32af6baf","Type":"ContainerStarted","Data":"61b5939f22539095c019de46528b34a2b0a22e581b6e91a7af3d873b95cd7d53"}
Jul 27 19:27:36.434661 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:36.434246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:36.460341 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:36.460282    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x2r4v" podStartSLOduration=190.60875917 podStartE2EDuration="3m12.460268149s" totalImagesPullingTime="1.851508979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:36.459112201 +0000 UTC m=+227.330298852" watchObservedRunningTime="2026-07-27 19:27:36.460268149 +0000 UTC m=+227.331454799"
Jul 27 19:27:40.580563 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:40.580511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:40.581006 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:40.580987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"
Jul 27 19:27:40.711031 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:40.711006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6q6rz"]
Jul 27 19:27:40.713223 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:40.713193    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb3e6de_b7f1_4520_b94f_127fa6c49003.slice/crio-94763411e48562b4a7cb80cf08e9aeba861ce016f324f7bce35095f8d16fad48 WatchSource:0}: Error finding container 94763411e48562b4a7cb80cf08e9aeba861ce016f324f7bce35095f8d16fad48: Status 404 returned error can't find the container with id 94763411e48562b4a7cb80cf08e9aeba861ce016f324f7bce35095f8d16fad48
Jul 27 19:27:41.452141 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:41.452108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" event={"ID":"cdb3e6de-b7f1-4520-b94f-127fa6c49003","Type":"ContainerStarted","Data":"94763411e48562b4a7cb80cf08e9aeba861ce016f324f7bce35095f8d16fad48"}
Jul 27 19:27:42.457707 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:42.457616    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" event={"ID":"cdb3e6de-b7f1-4520-b94f-127fa6c49003","Type":"ContainerStarted","Data":"d81eacb53aa225c0090be369367d3f27879c0ab34cb6a16014b54b23c8f71b99"}
Jul 27 19:27:42.457707 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:42.457686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" event={"ID":"cdb3e6de-b7f1-4520-b94f-127fa6c49003","Type":"ContainerStarted","Data":"c264d2967aa5342f47de6657adc688c9210a1dd0cab6f8f202538d59c5d569af"}
Jul 27 19:27:42.479215 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:42.478840    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-6q6rz" podStartSLOduration=87.102228029 podStartE2EDuration="1m28.47881991s" totalImagesPullingTime="1.376591881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:42.478245509 +0000 UTC m=+233.349432171" watchObservedRunningTime="2026-07-27 19:27:42.47881991 +0000 UTC m=+233.350006563"
Jul 27 19:27:44.109803 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.109764    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"]
Jul 27 19:27:44.113134 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.113109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.116118 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.116085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 19:27:44.116118 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.116089    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pxcmq\""
Jul 27 19:27:44.116478 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.116461    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 19:27:44.143703 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.143672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"]
Jul 27 19:27:44.169871 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.169839    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"]
Jul 27 19:27:44.173499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.173480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.178562 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.178315    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 19:27:44.179257 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.179212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 19:27:44.179434 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.179415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nzr25\""
Jul 27 19:27:44.179575 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.179254    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 19:27:44.193149 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.193123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.193293 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.193160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.193293 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.193202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsckj\" (UniqueName: \"kubernetes.io/projected/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-kube-api-access-tsckj\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.193293 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.193260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.203160 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.203131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"]
Jul 27 19:27:44.264048 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.264014    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b8mbb"]
Jul 27 19:27:44.267570 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.267541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.270791 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.270769    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:27:44.271148 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.271128    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:27:44.271413 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.271394    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:27:44.271516 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.271394    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6nkqs\""
Jul 27 19:27:44.293860 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.293814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.294077 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.293864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.294077 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.293906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.294077 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.293934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4d12bf82-977e-4983-b53d-d3976756286f-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.294077 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.293986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.294077 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:44.294008    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 27 19:27:44.294077 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.294055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d12bf82-977e-4983-b53d-d3976756286f-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.294381 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:44.294085    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-tls podName:0ebf3b5a-d584-4ba4-a1e0-b0730569b06a nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.794063982 +0000 UTC m=+235.665250616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-7729g" (UID: "0ebf3b5a-d584-4ba4-a1e0-b0730569b06a") : secret "openshift-state-metrics-tls" not found
Jul 27 19:27:44.294381 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.294324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbhb7\" (UniqueName: \"kubernetes.io/projected/4d12bf82-977e-4983-b53d-d3976756286f-kube-api-access-cbhb7\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.294381 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.294359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.294535 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.294395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsckj\" (UniqueName: \"kubernetes.io/projected/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-kube-api-access-tsckj\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.294535 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.294422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.294726 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.294696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.297170 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.297149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.309859 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.309828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsckj\" (UniqueName: \"kubernetes.io/projected/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-kube-api-access-tsckj\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.395998 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.395856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.395998 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.395969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396220 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-textfile\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396220 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-wtmp\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396220 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:44.396053    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 19:27:44.396220 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:44.396127    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-tls podName:4d12bf82-977e-4983-b53d-d3976756286f nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.896106848 +0000 UTC m=+235.767293481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-rq54k" (UID: "4d12bf82-977e-4983-b53d-d3976756286f") : secret "kube-state-metrics-tls" not found
Jul 27 19:27:44.396220 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-root\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396220 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-tls\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396220 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/110d4af9-6a4a-4924-ad4b-8fe553f131c6-metrics-client-ca\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396478 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.396478 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-sys\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396478 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4d12bf82-977e-4983-b53d-d3976756286f-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.396478 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d12bf82-977e-4983-b53d-d3976756286f-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.396478 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396478 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxzn\" (UniqueName: \"kubernetes.io/projected/110d4af9-6a4a-4924-ad4b-8fe553f131c6-kube-api-access-kzxzn\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.396725 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbhb7\" (UniqueName: \"kubernetes.io/projected/4d12bf82-977e-4983-b53d-d3976756286f-kube-api-access-cbhb7\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.396725 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.396836 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.396809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4d12bf82-977e-4983-b53d-d3976756286f-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.397258 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.397230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.397393 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.397371    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d12bf82-977e-4983-b53d-d3976756286f-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.399573 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.399554    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.416455 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.416422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbhb7\" (UniqueName: \"kubernetes.io/projected/4d12bf82-977e-4983-b53d-d3976756286f-kube-api-access-cbhb7\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.497340 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497524 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxzn\" (UniqueName: \"kubernetes.io/projected/110d4af9-6a4a-4924-ad4b-8fe553f131c6-kube-api-access-kzxzn\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497524 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497524 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-textfile\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497524 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-wtmp\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497752 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-root\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497752 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-tls\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497752 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/110d4af9-6a4a-4924-ad4b-8fe553f131c6-metrics-client-ca\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497752 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-sys\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.497752 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-sys\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.498037 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-root\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.498037 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.497878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-wtmp\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.498037 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:44.497894    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 19:27:44.498037 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:44.497975    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-tls podName:110d4af9-6a4a-4924-ad4b-8fe553f131c6 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:44.99793683 +0000 UTC m=+235.869123464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-tls") pod "node-exporter-b8mbb" (UID: "110d4af9-6a4a-4924-ad4b-8fe553f131c6") : secret "node-exporter-tls" not found
Jul 27 19:27:44.498246 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.498102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-textfile\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.498404 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.498384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/110d4af9-6a4a-4924-ad4b-8fe553f131c6-metrics-client-ca\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.498470 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.498455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.500350 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.500324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.508891 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.508861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxzn\" (UniqueName: \"kubernetes.io/projected/110d4af9-6a4a-4924-ad4b-8fe553f131c6-kube-api-access-kzxzn\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:44.800424 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.800387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.802830 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.802812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ebf3b5a-d584-4ba4-a1e0-b0730569b06a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-7729g\" (UID: \"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:44.901379 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.901339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:44.904229 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:44.904209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d12bf82-977e-4983-b53d-d3976756286f-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rq54k\" (UID: \"4d12bf82-977e-4983-b53d-d3976756286f\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:45.002273 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.002229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-tls\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:45.004636 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.004615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/110d4af9-6a4a-4924-ad4b-8fe553f131c6-node-exporter-tls\") pod \"node-exporter-b8mbb\" (UID: \"110d4af9-6a4a-4924-ad4b-8fe553f131c6\") " pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:45.025642 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.025603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"
Jul 27 19:27:45.087210 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.087175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"
Jul 27 19:27:45.180208 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.180175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b8mbb"
Jul 27 19:27:45.192622 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:45.192586    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod110d4af9_6a4a_4924_ad4b_8fe553f131c6.slice/crio-749d70f42fed479f791c5e9cf534b6ca6e5493cc3d1e1cd4c34c39cf6547ed85 WatchSource:0}: Error finding container 749d70f42fed479f791c5e9cf534b6ca6e5493cc3d1e1cd4c34c39cf6547ed85: Status 404 returned error can't find the container with id 749d70f42fed479f791c5e9cf534b6ca6e5493cc3d1e1cd4c34c39cf6547ed85
Jul 27 19:27:45.198398 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.197923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g"]
Jul 27 19:27:45.203519 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:45.203160    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebf3b5a_d584_4ba4_a1e0_b0730569b06a.slice/crio-1697ec76e63a57bd083e17c5a1495c8f46d1535d088b57efc8a58dfdf532c7b5 WatchSource:0}: Error finding container 1697ec76e63a57bd083e17c5a1495c8f46d1535d088b57efc8a58dfdf532c7b5: Status 404 returned error can't find the container with id 1697ec76e63a57bd083e17c5a1495c8f46d1535d088b57efc8a58dfdf532c7b5
Jul 27 19:27:45.265102 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.265047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k"]
Jul 27 19:27:45.269905 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:45.269875    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d12bf82_977e_4983_b53d_d3976756286f.slice/crio-4d0079896d795ae75e1a5ee1c684b54a047abb06f7073fdce0d6346df66bb1df WatchSource:0}: Error finding container 4d0079896d795ae75e1a5ee1c684b54a047abb06f7073fdce0d6346df66bb1df: Status 404 returned error can't find the container with id 4d0079896d795ae75e1a5ee1c684b54a047abb06f7073fdce0d6346df66bb1df
Jul 27 19:27:45.270561 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.270539    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:27:45.276798 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.276777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.281024 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.280993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 19:27:45.282056 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.282022    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 19:27:45.282359 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.282224    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 19:27:45.282359 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.282285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hc55z\""
Jul 27 19:27:45.282519 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.282447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 19:27:45.282571 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.282551    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 19:27:45.287087 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.287066    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 19:27:45.287378 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.287358    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 19:27:45.296978 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.293778    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 19:27:45.298612 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.298588    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 19:27:45.318256 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.318227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:27:45.406300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-out\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmm28\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-kube-api-access-lmm28\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-volume\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.406724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.406690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-web-config\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.470885 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.470845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8mbb" event={"ID":"110d4af9-6a4a-4924-ad4b-8fe553f131c6","Type":"ContainerStarted","Data":"749d70f42fed479f791c5e9cf534b6ca6e5493cc3d1e1cd4c34c39cf6547ed85"}
Jul 27 19:27:45.472068 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.472038    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k" event={"ID":"4d12bf82-977e-4983-b53d-d3976756286f","Type":"ContainerStarted","Data":"4d0079896d795ae75e1a5ee1c684b54a047abb06f7073fdce0d6346df66bb1df"}
Jul 27 19:27:45.473759 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.473737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g" event={"ID":"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a","Type":"ContainerStarted","Data":"09566b1e21cf583528562dc8b26d0b346eed9151a56efe06b13c423f7459a582"}
Jul 27 19:27:45.473863 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.473782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g" event={"ID":"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a","Type":"ContainerStarted","Data":"3a152f29d8b3c1a52a4fbdef0168cd4a938e91d0b0df7297706341aa68f6f801"}
Jul 27 19:27:45.473863 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.473800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g" event={"ID":"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a","Type":"ContainerStarted","Data":"1697ec76e63a57bd083e17c5a1495c8f46d1535d088b57efc8a58dfdf532c7b5"}
Jul 27 19:27:45.507331 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-out\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507331 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmm28\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-kube-api-access-lmm28\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-volume\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.507577 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-web-config\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.508052 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.508052 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.507625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.508566 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.508469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.508566 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.508506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.508759 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.508732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.510737 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.510683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-out\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.511660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.511352    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.511660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.511383    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.511660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.511515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.511660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.511532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.511903 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.511799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.511903 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.511875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-web-config\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.512396 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.512373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.513147 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.513128    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-volume\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.520279 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.520257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmm28\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-kube-api-access-lmm28\") pod \"alertmanager-main-0\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.588186 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.588151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:27:45.756185 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:45.756149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:27:45.759302 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:45.759254    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228e72b3_bc0e_4e44_a37e_53012f959ac1.slice/crio-1365deac1dc9291c27ef0ac9d2216a86c70f76eada81fdd0bec47622751ba7e5 WatchSource:0}: Error finding container 1365deac1dc9291c27ef0ac9d2216a86c70f76eada81fdd0bec47622751ba7e5: Status 404 returned error can't find the container with id 1365deac1dc9291c27ef0ac9d2216a86c70f76eada81fdd0bec47622751ba7e5
Jul 27 19:27:46.439611 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:46.439580    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x2r4v"
Jul 27 19:27:46.480073 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:46.480038    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8mbb" event={"ID":"110d4af9-6a4a-4924-ad4b-8fe553f131c6","Type":"ContainerStarted","Data":"8f66501d020060f534ad3bebe7499981c5eb66fb7bb0d90a2798ed1e711c1fa6"}
Jul 27 19:27:46.481919 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:46.481850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerStarted","Data":"1365deac1dc9291c27ef0ac9d2216a86c70f76eada81fdd0bec47622751ba7e5"}
Jul 27 19:27:47.490253 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.490220    2563 generic.go:356] "Generic (PLEG): container finished" podID="110d4af9-6a4a-4924-ad4b-8fe553f131c6" containerID="8f66501d020060f534ad3bebe7499981c5eb66fb7bb0d90a2798ed1e711c1fa6" exitCode=0
Jul 27 19:27:47.490650 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.490306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8mbb" event={"ID":"110d4af9-6a4a-4924-ad4b-8fe553f131c6","Type":"ContainerDied","Data":"8f66501d020060f534ad3bebe7499981c5eb66fb7bb0d90a2798ed1e711c1fa6"}
Jul 27 19:27:47.493568 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.493533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k" event={"ID":"4d12bf82-977e-4983-b53d-d3976756286f","Type":"ContainerStarted","Data":"56830c2a7cf4914332b36bbceee99caaee62895cf07a8f62d7cd2aded6790bb0"}
Jul 27 19:27:47.493698 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.493609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k" event={"ID":"4d12bf82-977e-4983-b53d-d3976756286f","Type":"ContainerStarted","Data":"3185407a4a542a43e19b9c9560cba2d0d0a844a974295ec1d5da5ca3df10c5b9"}
Jul 27 19:27:47.496657 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.496591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g" event={"ID":"0ebf3b5a-d584-4ba4-a1e0-b0730569b06a","Type":"ContainerStarted","Data":"362d6c493c5e16875b8db0b82bcc026790dca525d922cb7edde626747f4ee194"}
Jul 27 19:27:47.500049 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.500022    2563 generic.go:356] "Generic (PLEG): container finished" podID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerID="ca04e74439f69f9542e73758e240ffedbccef128c83c0eeea10a0aebda4bb2b5" exitCode=0
Jul 27 19:27:47.500126 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.500115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"ca04e74439f69f9542e73758e240ffedbccef128c83c0eeea10a0aebda4bb2b5"}
Jul 27 19:27:47.559751 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:47.559698    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-7729g" podStartSLOduration=1.657496005 podStartE2EDuration="3.559679122s" totalImagesPullingTime="1.902183117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:47.558102639 +0000 UTC m=+238.429289306" watchObservedRunningTime="2026-07-27 19:27:47.559679122 +0000 UTC m=+238.430865773"
Jul 27 19:27:48.507362 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.507326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8mbb" event={"ID":"110d4af9-6a4a-4924-ad4b-8fe553f131c6","Type":"ContainerStarted","Data":"ad3415c2d59642d882b3fd44e866c3fa2c10136b4a31488e8f288ee1bb628af7"}
Jul 27 19:27:48.507828 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.507427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b8mbb" event={"ID":"110d4af9-6a4a-4924-ad4b-8fe553f131c6","Type":"ContainerStarted","Data":"e176e1e4125001d80e6d89257fa212dbb879039e68ff11171e80313c167b40a7"}
Jul 27 19:27:48.510336 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.510298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k" event={"ID":"4d12bf82-977e-4983-b53d-d3976756286f","Type":"ContainerStarted","Data":"867872d197cc9be5be333c5d07824b49f73f36257eadff94c4770ea0a546d2cf"}
Jul 27 19:27:48.528274 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.528237    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"]
Jul 27 19:27:48.531900 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.531870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.536639 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.536617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 19:27:48.537075 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.536979    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 19:27:48.537075 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.536997    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7i72grq1slp38\""
Jul 27 19:27:48.537075 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.537013    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 19:27:48.537075 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.537058    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j86fh\""
Jul 27 19:27:48.537507 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.537203    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 19:27:48.541358 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.541303    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b8mbb" podStartSLOduration=3.325125519 podStartE2EDuration="4.541288014s" totalImagesPullingTime="1.13484983s" totalInitContainerRuntime="81.312665ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:48.540507741 +0000 UTC m=+239.411694393" watchObservedRunningTime="2026-07-27 19:27:48.541288014 +0000 UTC m=+239.412474664"
Jul 27 19:27:48.545380 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.545358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"]
Jul 27 19:27:48.589120 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.589068    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rq54k" podStartSLOduration=2.609944018 podStartE2EDuration="4.589046626s" totalImagesPullingTime="1.979102608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:48.588055827 +0000 UTC m=+239.459242478" watchObservedRunningTime="2026-07-27 19:27:48.589046626 +0000 UTC m=+239.460233278"
Jul 27 19:27:48.633118 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.633078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-client-ca-bundle\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.633285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.633131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/484fee4d-915f-4c60-aa7c-9e60883bd096-audit-log\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.633285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.633254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-secret-metrics-server-tls\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.633423 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.633394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns2kh\" (UniqueName: \"kubernetes.io/projected/484fee4d-915f-4c60-aa7c-9e60883bd096-kube-api-access-ns2kh\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.633502 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.633482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484fee4d-915f-4c60-aa7c-9e60883bd096-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.633561 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.633523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/484fee4d-915f-4c60-aa7c-9e60883bd096-metrics-server-audit-profiles\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.633717 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.633690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-secret-metrics-server-client-certs\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.734798 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.734765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns2kh\" (UniqueName: \"kubernetes.io/projected/484fee4d-915f-4c60-aa7c-9e60883bd096-kube-api-access-ns2kh\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.734994 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.734819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484fee4d-915f-4c60-aa7c-9e60883bd096-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.734994 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.734842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/484fee4d-915f-4c60-aa7c-9e60883bd096-metrics-server-audit-profiles\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.734994 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.734882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-secret-metrics-server-client-certs\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.734994 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.734935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-client-ca-bundle\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.735200 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.735158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/484fee4d-915f-4c60-aa7c-9e60883bd096-audit-log\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.735259 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.735210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-secret-metrics-server-tls\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.735621 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.735564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/484fee4d-915f-4c60-aa7c-9e60883bd096-audit-log\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.735899 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.735619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484fee4d-915f-4c60-aa7c-9e60883bd096-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.736044 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.735998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/484fee4d-915f-4c60-aa7c-9e60883bd096-metrics-server-audit-profiles\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.737927 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.737905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-secret-metrics-server-tls\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.738387 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.738367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-client-ca-bundle\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.738500 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.738480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/484fee4d-915f-4c60-aa7c-9e60883bd096-secret-metrics-server-client-certs\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.751421 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.751396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns2kh\" (UniqueName: \"kubernetes.io/projected/484fee4d-915f-4c60-aa7c-9e60883bd096-kube-api-access-ns2kh\") pod \"metrics-server-6c7879ffcc-s2bgd\" (UID: \"484fee4d-915f-4c60-aa7c-9e60883bd096\") " pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.845379 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.845341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:27:48.886868 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.886832    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"]
Jul 27 19:27:48.891555 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.891523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:48.896562 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.896532    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 19:27:48.896905 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.896831    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gsx4z\""
Jul 27 19:27:48.910329 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:48.910298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"]
Jul 27 19:27:49.011098 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.010966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"]
Jul 27 19:27:49.037880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.037850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhpzj\" (UniqueName: \"kubernetes.io/projected/54925c1b-f726-4a0a-b4e3-a222e315ac01-kube-api-access-qhpzj\") pod \"monitoring-plugin-68b7fc9574-gdpxd\" (UID: \"54925c1b-f726-4a0a-b4e3-a222e315ac01\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.038063 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.037902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54925c1b-f726-4a0a-b4e3-a222e315ac01-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gdpxd\" (UID: \"54925c1b-f726-4a0a-b4e3-a222e315ac01\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.139350 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.139269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhpzj\" (UniqueName: \"kubernetes.io/projected/54925c1b-f726-4a0a-b4e3-a222e315ac01-kube-api-access-qhpzj\") pod \"monitoring-plugin-68b7fc9574-gdpxd\" (UID: \"54925c1b-f726-4a0a-b4e3-a222e315ac01\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.139350 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.139336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54925c1b-f726-4a0a-b4e3-a222e315ac01-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gdpxd\" (UID: \"54925c1b-f726-4a0a-b4e3-a222e315ac01\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.139558 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:49.139478    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 19:27:49.139558 ip-10-0-130-91 kubenswrapper[2563]: E0727 19:27:49.139548    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54925c1b-f726-4a0a-b4e3-a222e315ac01-monitoring-plugin-cert podName:54925c1b-f726-4a0a-b4e3-a222e315ac01 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:49.639526801 +0000 UTC m=+240.510713429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/54925c1b-f726-4a0a-b4e3-a222e315ac01-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-gdpxd" (UID: "54925c1b-f726-4a0a-b4e3-a222e315ac01") : secret "monitoring-plugin-cert" not found
Jul 27 19:27:49.154728 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.154701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhpzj\" (UniqueName: \"kubernetes.io/projected/54925c1b-f726-4a0a-b4e3-a222e315ac01-kube-api-access-qhpzj\") pod \"monitoring-plugin-68b7fc9574-gdpxd\" (UID: \"54925c1b-f726-4a0a-b4e3-a222e315ac01\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.317192 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:49.317160    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484fee4d_915f_4c60_aa7c_9e60883bd096.slice/crio-4ad9f13d16ecc8f0d72930e8ce06947ea700cdd47bcd331fe04731c1399e622b WatchSource:0}: Error finding container 4ad9f13d16ecc8f0d72930e8ce06947ea700cdd47bcd331fe04731c1399e622b: Status 404 returned error can't find the container with id 4ad9f13d16ecc8f0d72930e8ce06947ea700cdd47bcd331fe04731c1399e622b
Jul 27 19:27:49.324022 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.323999    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"]
Jul 27 19:27:49.327360 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.327341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.330311 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.330286    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 19:27:49.330436 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.330317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 19:27:49.330506 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.330461    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mw7t2\""
Jul 27 19:27:49.330634 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.330619    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 19:27:49.330714 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.330682    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 19:27:49.330774 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.330759    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 19:27:49.335924 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.335894    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 19:27:49.343162 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.343139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"]
Jul 27 19:27:49.441617 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-serving-certs-ca-bundle\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.441748 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.441748 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-federate-client-tls\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.441748 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtlvz\" (UniqueName: \"kubernetes.io/projected/d55c4f78-8664-4da0-8484-6bd79393e0e0-kube-api-access-jtlvz\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.441887 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-telemeter-client-tls\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.441887 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-secret-telemeter-client\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.441887 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.442042 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.441919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-metrics-client-ca\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.522834 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.522806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerStarted","Data":"4fa5f804ceb16164b9cfd5e6da5243dded7a1b859cd3c886dcb80f12f9eace09"}
Jul 27 19:27:49.523258 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.522894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerStarted","Data":"c00c69a957194e2a6052395f39ef1746a50a7284ee189160a52fc185e31f9c96"}
Jul 27 19:27:49.524112 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.524084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd" event={"ID":"484fee4d-915f-4c60-aa7c-9e60883bd096","Type":"ContainerStarted","Data":"4ad9f13d16ecc8f0d72930e8ce06947ea700cdd47bcd331fe04731c1399e622b"}
Jul 27 19:27:49.542380 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-secret-telemeter-client\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.542491 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.542491 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-metrics-client-ca\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.542491 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-serving-certs-ca-bundle\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.542662 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.542662 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-federate-client-tls\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.542662 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtlvz\" (UniqueName: \"kubernetes.io/projected/d55c4f78-8664-4da0-8484-6bd79393e0e0-kube-api-access-jtlvz\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.542662 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.542581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-telemeter-client-tls\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.543383 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.543349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-metrics-client-ca\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.545904 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.545884    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 19:27:49.546025 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.545982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 19:27:49.546025 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.545999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 19:27:49.546025 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.546008    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 19:27:49.546420 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.546405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 19:27:49.551835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.551813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 19:27:49.554326 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.554297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-serving-certs-ca-bundle\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.554449 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.554301    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d55c4f78-8664-4da0-8484-6bd79393e0e0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.555876 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.555839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.555997 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.555972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-federate-client-tls\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.556412 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.556390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-telemeter-client-tls\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.556455 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.556416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d55c4f78-8664-4da0-8484-6bd79393e0e0-secret-telemeter-client\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.556877 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.556856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtlvz\" (UniqueName: \"kubernetes.io/projected/d55c4f78-8664-4da0-8484-6bd79393e0e0-kube-api-access-jtlvz\") pod \"telemeter-client-6d494d5f68-8rsp2\" (UID: \"d55c4f78-8664-4da0-8484-6bd79393e0e0\") " pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.642073 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.642001    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mw7t2\""
Jul 27 19:27:49.643667 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.643519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54925c1b-f726-4a0a-b4e3-a222e315ac01-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gdpxd\" (UID: \"54925c1b-f726-4a0a-b4e3-a222e315ac01\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.646215 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.646197    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54925c1b-f726-4a0a-b4e3-a222e315ac01-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-gdpxd\" (UID: \"54925c1b-f726-4a0a-b4e3-a222e315ac01\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.649177 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.649155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"
Jul 27 19:27:49.798528 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.798501    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d494d5f68-8rsp2"]
Jul 27 19:27:49.801040 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:49.801014    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55c4f78_8664_4da0_8484_6bd79393e0e0.slice/crio-0ec9ca75c07236820d3ed101652ea522bdd93d403a5db2b123aa298c75671e62 WatchSource:0}: Error finding container 0ec9ca75c07236820d3ed101652ea522bdd93d403a5db2b123aa298c75671e62: Status 404 returned error can't find the container with id 0ec9ca75c07236820d3ed101652ea522bdd93d403a5db2b123aa298c75671e62
Jul 27 19:27:49.818267 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.818235    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gsx4z\""
Jul 27 19:27:49.825501 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.825479    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:49.953905 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:49.953872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"]
Jul 27 19:27:49.956883 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:27:49.956861    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54925c1b_f726_4a0a_b4e3_a222e315ac01.slice/crio-9ae12da842719dc4ebca0af4dba2cc33e95aaeda1d35ac10ed452ef2134a9ae6 WatchSource:0}: Error finding container 9ae12da842719dc4ebca0af4dba2cc33e95aaeda1d35ac10ed452ef2134a9ae6: Status 404 returned error can't find the container with id 9ae12da842719dc4ebca0af4dba2cc33e95aaeda1d35ac10ed452ef2134a9ae6
Jul 27 19:27:50.532356 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:50.532256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd" event={"ID":"54925c1b-f726-4a0a-b4e3-a222e315ac01","Type":"ContainerStarted","Data":"9ae12da842719dc4ebca0af4dba2cc33e95aaeda1d35ac10ed452ef2134a9ae6"}
Jul 27 19:27:50.535190 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:50.535160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2" event={"ID":"d55c4f78-8664-4da0-8484-6bd79393e0e0","Type":"ContainerStarted","Data":"0ec9ca75c07236820d3ed101652ea522bdd93d403a5db2b123aa298c75671e62"}
Jul 27 19:27:50.539572 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:50.539410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerStarted","Data":"6076beb3df37a8f596abeaa1821e856af7019b561ec0b6d032f2bf10c20be2c6"}
Jul 27 19:27:50.539572 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:50.539485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerStarted","Data":"faaff486a7f9d8b05181e9b20a96858f36698a76471a02b2f617b51088c1207c"}
Jul 27 19:27:50.539572 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:50.539524    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerStarted","Data":"c73d52d065b7c3380f766f73bcc3e765052b50495f8c5dd68a14157f3ff2e995"}
Jul 27 19:27:51.553779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:51.553739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerStarted","Data":"bbc02f0bd4f9e4d6e0559ef64e64198dc3f98a7d94fac6ffb3a255db256509d4"}
Jul 27 19:27:51.593535 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:51.593473    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.0655206 podStartE2EDuration="6.593452165s" totalImagesPullingTime="4.499800657s" totalInitContainerRuntime="28.130908ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:51.592012781 +0000 UTC m=+242.463199435" watchObservedRunningTime="2026-07-27 19:27:51.593452165 +0000 UTC m=+242.464638816"
Jul 27 19:27:53.562686 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.562645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd" event={"ID":"484fee4d-915f-4c60-aa7c-9e60883bd096","Type":"ContainerStarted","Data":"4dd949137bf4ff943c96b2e4002477e34f5e9e042aab8600622846b5789361fa"}
Jul 27 19:27:53.564188 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.564165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd" event={"ID":"54925c1b-f726-4a0a-b4e3-a222e315ac01","Type":"ContainerStarted","Data":"8edcbae69524625eb9fe6ef05a84ab954331fee4ac51bbf895236a11c8a6727e"}
Jul 27 19:27:53.564332 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.564315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:53.566412 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.566388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2" event={"ID":"d55c4f78-8664-4da0-8484-6bd79393e0e0","Type":"ContainerStarted","Data":"01738aa188c8a66892dcf66bb3ed42ff4460e318fa21d12105ff997cc10ae992"}
Jul 27 19:27:53.566522 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.566437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2" event={"ID":"d55c4f78-8664-4da0-8484-6bd79393e0e0","Type":"ContainerStarted","Data":"e06acbb9094e1c9920d9f39f6147a862c5ef42f1cb5fece14b846e9fc96c48ab"}
Jul 27 19:27:53.566522 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.566470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2" event={"ID":"d55c4f78-8664-4da0-8484-6bd79393e0e0","Type":"ContainerStarted","Data":"0fbc20d9e323e2dd24ff53b96998f21d62def92383d254839940c587cc0e378b"}
Jul 27 19:27:53.569570 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.569552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd"
Jul 27 19:27:53.583317 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.583268    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd" podStartSLOduration=2.353317511 podStartE2EDuration="5.583250749s" totalImagesPullingTime="3.229933238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:53.582853095 +0000 UTC m=+244.454039757" watchObservedRunningTime="2026-07-27 19:27:53.583250749 +0000 UTC m=+244.454437421"
Jul 27 19:27:53.639587 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.639528    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d494d5f68-8rsp2" podStartSLOduration=1.891034817 podStartE2EDuration="4.639506485s" totalImagesPullingTime="2.748471668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:53.637447626 +0000 UTC m=+244.508634278" watchObservedRunningTime="2026-07-27 19:27:53.639506485 +0000 UTC m=+244.510693136"
Jul 27 19:27:53.663139 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:27:53.663089    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-gdpxd" podStartSLOduration=3.069360992 podStartE2EDuration="5.663072168s" totalImagesPullingTime="2.593711176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:53.661286033 +0000 UTC m=+244.532472704" watchObservedRunningTime="2026-07-27 19:27:53.663072168 +0000 UTC m=+244.534258817"
Jul 27 19:28:08.845611 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:28:08.845559    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:28:08.846028 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:28:08.845621    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:28:28.850528 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:28:28.850451    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:28:28.854319 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:28:28.854298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c7879ffcc-s2bgd"
Jul 27 19:28:49.505399 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:28:49.505372    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:29:04.662360 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.662323    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:29:04.665195 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.662621    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="alertmanager" containerID="cri-o://c00c69a957194e2a6052395f39ef1746a50a7284ee189160a52fc185e31f9c96" gracePeriod=120
Jul 27 19:29:04.665195 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.662707    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-metric" containerID="cri-o://6076beb3df37a8f596abeaa1821e856af7019b561ec0b6d032f2bf10c20be2c6" gracePeriod=120
Jul 27 19:29:04.665195 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.663121    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-web" containerID="cri-o://c73d52d065b7c3380f766f73bcc3e765052b50495f8c5dd68a14157f3ff2e995" gracePeriod=120
Jul 27 19:29:04.668707 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.668310    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="config-reloader" containerID="cri-o://4fa5f804ceb16164b9cfd5e6da5243dded7a1b859cd3c886dcb80f12f9eace09" gracePeriod=120
Jul 27 19:29:04.668707 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.668532    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="prom-label-proxy" containerID="cri-o://bbc02f0bd4f9e4d6e0559ef64e64198dc3f98a7d94fac6ffb3a255db256509d4" gracePeriod=120
Jul 27 19:29:04.669167 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.669118    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy" containerID="cri-o://faaff486a7f9d8b05181e9b20a96858f36698a76471a02b2f617b51088c1207c" gracePeriod=120
Jul 27 19:29:04.855254 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855224    2563 generic.go:356] "Generic (PLEG): container finished" podID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerID="bbc02f0bd4f9e4d6e0559ef64e64198dc3f98a7d94fac6ffb3a255db256509d4" exitCode=0
Jul 27 19:29:04.855254 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855248    2563 generic.go:356] "Generic (PLEG): container finished" podID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerID="faaff486a7f9d8b05181e9b20a96858f36698a76471a02b2f617b51088c1207c" exitCode=0
Jul 27 19:29:04.855254 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855254    2563 generic.go:356] "Generic (PLEG): container finished" podID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerID="4fa5f804ceb16164b9cfd5e6da5243dded7a1b859cd3c886dcb80f12f9eace09" exitCode=0
Jul 27 19:29:04.855254 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855259    2563 generic.go:356] "Generic (PLEG): container finished" podID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerID="c00c69a957194e2a6052395f39ef1746a50a7284ee189160a52fc185e31f9c96" exitCode=0
Jul 27 19:29:04.855595 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"bbc02f0bd4f9e4d6e0559ef64e64198dc3f98a7d94fac6ffb3a255db256509d4"}
Jul 27 19:29:04.855595 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"faaff486a7f9d8b05181e9b20a96858f36698a76471a02b2f617b51088c1207c"}
Jul 27 19:29:04.855595 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"4fa5f804ceb16164b9cfd5e6da5243dded7a1b859cd3c886dcb80f12f9eace09"}
Jul 27 19:29:04.855595 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:04.855499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"c00c69a957194e2a6052395f39ef1746a50a7284ee189160a52fc185e31f9c96"}
Jul 27 19:29:05.863213 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.863184    2563 generic.go:356] "Generic (PLEG): container finished" podID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerID="6076beb3df37a8f596abeaa1821e856af7019b561ec0b6d032f2bf10c20be2c6" exitCode=0
Jul 27 19:29:05.863213 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.863209    2563 generic.go:356] "Generic (PLEG): container finished" podID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerID="c73d52d065b7c3380f766f73bcc3e765052b50495f8c5dd68a14157f3ff2e995" exitCode=0
Jul 27 19:29:05.863590 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.863253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"6076beb3df37a8f596abeaa1821e856af7019b561ec0b6d032f2bf10c20be2c6"}
Jul 27 19:29:05.863590 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.863312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"c73d52d065b7c3380f766f73bcc3e765052b50495f8c5dd68a14157f3ff2e995"}
Jul 27 19:29:05.911939 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.911916    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:05.980292 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980253    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-main-tls\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980300    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980338    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-web\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980421    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-tls-assets\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980462    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmm28\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-kube-api-access-lmm28\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980778 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-main-db\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980847 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980805    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-web-config\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980847 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980835    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980992 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-volume\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.980992 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.980907    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-trusted-ca-bundle\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.981112 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.981009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:05.981112 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.981058    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-out\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.981248 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.981191    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-metrics-client-ca\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.981248 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.981226    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-cluster-tls-config\") pod \"228e72b3-bc0e-4e44-a37e-53012f959ac1\" (UID: \"228e72b3-bc0e-4e44-a37e-53012f959ac1\") "
Jul 27 19:29:05.981528 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.981503    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-main-db\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:05.982104 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.981639    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:29:05.982692 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.982654    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:29:05.984634 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.984558    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:05.984634 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.984585    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-kube-api-access-lmm28" (OuterVolumeSpecName: "kube-api-access-lmm28") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "kube-api-access-lmm28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:05.984634 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.984609    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:05.984848 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.984636    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:05.984848 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.984718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:05.984965 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.984921    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-volume" (OuterVolumeSpecName: "config-volume") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:05.985014 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.984941    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:05.985296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.985279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-out" (OuterVolumeSpecName: "config-out") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:05.989858 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.989837    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:05.996937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:05.996910    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-web-config" (OuterVolumeSpecName: "web-config") pod "228e72b3-bc0e-4e44-a37e-53012f959ac1" (UID: "228e72b3-bc0e-4e44-a37e-53012f959ac1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:06.081875 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081837    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-web-config\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.081875 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081866    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.081875 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081876    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-volume\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.081875 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081885    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081893    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/228e72b3-bc0e-4e44-a37e-53012f959ac1-config-out\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081901    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/228e72b3-bc0e-4e44-a37e-53012f959ac1-metrics-client-ca\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081910    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-cluster-tls-config\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081920    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-main-tls\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081928    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081938    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/228e72b3-bc0e-4e44-a37e-53012f959ac1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081959    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-tls-assets\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.082226 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.081967    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmm28\" (UniqueName: \"kubernetes.io/projected/228e72b3-bc0e-4e44-a37e-53012f959ac1-kube-api-access-lmm28\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:29:06.870491 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.870456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"228e72b3-bc0e-4e44-a37e-53012f959ac1","Type":"ContainerDied","Data":"1365deac1dc9291c27ef0ac9d2216a86c70f76eada81fdd0bec47622751ba7e5"}
Jul 27 19:29:06.870882 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.870501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.870882 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.870532    2563 scope.go:117] "RemoveContainer" containerID="bbc02f0bd4f9e4d6e0559ef64e64198dc3f98a7d94fac6ffb3a255db256509d4"
Jul 27 19:29:06.879070 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.879053    2563 scope.go:117] "RemoveContainer" containerID="6076beb3df37a8f596abeaa1821e856af7019b561ec0b6d032f2bf10c20be2c6"
Jul 27 19:29:06.885803 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.885789    2563 scope.go:117] "RemoveContainer" containerID="faaff486a7f9d8b05181e9b20a96858f36698a76471a02b2f617b51088c1207c"
Jul 27 19:29:06.892683 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.892670    2563 scope.go:117] "RemoveContainer" containerID="c73d52d065b7c3380f766f73bcc3e765052b50495f8c5dd68a14157f3ff2e995"
Jul 27 19:29:06.898602 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.898582    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:29:06.899705 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.899689    2563 scope.go:117] "RemoveContainer" containerID="4fa5f804ceb16164b9cfd5e6da5243dded7a1b859cd3c886dcb80f12f9eace09"
Jul 27 19:29:06.906522 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.906508    2563 scope.go:117] "RemoveContainer" containerID="c00c69a957194e2a6052395f39ef1746a50a7284ee189160a52fc185e31f9c96"
Jul 27 19:29:06.911388 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.911367    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:29:06.914103 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.914089    2563 scope.go:117] "RemoveContainer" containerID="ca04e74439f69f9542e73758e240ffedbccef128c83c0eeea10a0aebda4bb2b5"
Jul 27 19:29:06.949761 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.949739    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:29:06.950037 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950024    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="init-config-reloader"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950038    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="init-config-reloader"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950047    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950052    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950058    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-metric"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950064    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-metric"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950077    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="alertmanager"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950082    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="alertmanager"
Jul 27 19:29:06.950090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950093    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-web"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950099    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-web"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950107    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="prom-label-proxy"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950112    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="prom-label-proxy"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950120    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="config-reloader"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950127    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="config-reloader"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950196    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="config-reloader"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950205    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="prom-label-proxy"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950212    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="alertmanager"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950217    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-web"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950224    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy"
Jul 27 19:29:06.950300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.950229    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" containerName="kube-rbac-proxy-metric"
Jul 27 19:29:06.953700 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.953686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.956838 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.956819    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 19:29:06.956985 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.956820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 19:29:06.956985 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.956852    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 19:29:06.956985 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.956921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hc55z\""
Jul 27 19:29:06.957160 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.957146    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 19:29:06.957381 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.957365    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 19:29:06.957427 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.957388    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 19:29:06.957427 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.957367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 19:29:06.957717 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.957701    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 19:29:06.963550 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.963531    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 19:29:06.977909 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.977884    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:29:06.990237 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6afd3b-27c1-4b60-b72d-9caff655bea9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990342 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990342 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqjdm\" (UniqueName: \"kubernetes.io/projected/5f6afd3b-27c1-4b60-b72d-9caff655bea9-kube-api-access-xqjdm\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990342 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f6afd3b-27c1-4b60-b72d-9caff655bea9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f6afd3b-27c1-4b60-b72d-9caff655bea9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-web-config\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f6afd3b-27c1-4b60-b72d-9caff655bea9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990734 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f6afd3b-27c1-4b60-b72d-9caff655bea9-config-out\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990734 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:06.990734 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:06.990608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.091874 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.091845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6afd3b-27c1-4b60-b72d-9caff655bea9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.091899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.091927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqjdm\" (UniqueName: \"kubernetes.io/projected/5f6afd3b-27c1-4b60-b72d-9caff655bea9-kube-api-access-xqjdm\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.091966    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.091987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f6afd3b-27c1-4b60-b72d-9caff655bea9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f6afd3b-27c1-4b60-b72d-9caff655bea9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092072 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-web-config\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092403 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f6afd3b-27c1-4b60-b72d-9caff655bea9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092403 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092403 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f6afd3b-27c1-4b60-b72d-9caff655bea9-config-out\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092403 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.092403 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.093132 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f6afd3b-27c1-4b60-b72d-9caff655bea9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.093132 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.092692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6afd3b-27c1-4b60-b72d-9caff655bea9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.093970 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.093580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f6afd3b-27c1-4b60-b72d-9caff655bea9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.095214 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.095189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.095469 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.095443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.095581 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.095470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-web-config\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.095646 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.095625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.095728 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.095696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.095800 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.095780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f6afd3b-27c1-4b60-b72d-9caff655bea9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.096334 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.096317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.096598 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.096581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f6afd3b-27c1-4b60-b72d-9caff655bea9-config-out\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.097209 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.097195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f6afd3b-27c1-4b60-b72d-9caff655bea9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.102210 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.102193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqjdm\" (UniqueName: \"kubernetes.io/projected/5f6afd3b-27c1-4b60-b72d-9caff655bea9-kube-api-access-xqjdm\") pod \"alertmanager-main-0\" (UID: \"5f6afd3b-27c1-4b60-b72d-9caff655bea9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.263599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.263572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 19:29:07.398642 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.398619    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 19:29:07.401079 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:29:07.401055    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6afd3b_27c1_4b60_b72d_9caff655bea9.slice/crio-a65178e89e619339e72968fc63a07c61b9f503aa453959325113a5639a87adc2 WatchSource:0}: Error finding container a65178e89e619339e72968fc63a07c61b9f503aa453959325113a5639a87adc2: Status 404 returned error can't find the container with id a65178e89e619339e72968fc63a07c61b9f503aa453959325113a5639a87adc2
Jul 27 19:29:07.585294 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.585264    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="228e72b3-bc0e-4e44-a37e-53012f959ac1" path="/var/lib/kubelet/pods/228e72b3-bc0e-4e44-a37e-53012f959ac1/volumes"
Jul 27 19:29:07.875568 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.875538    2563 generic.go:356] "Generic (PLEG): container finished" podID="5f6afd3b-27c1-4b60-b72d-9caff655bea9" containerID="56363303fb147465549c15a623f8c95e2714e99d3bc961dc58d4995a81c7634d" exitCode=0
Jul 27 19:29:07.876018 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.875632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerDied","Data":"56363303fb147465549c15a623f8c95e2714e99d3bc961dc58d4995a81c7634d"}
Jul 27 19:29:07.876018 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:07.875698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerStarted","Data":"a65178e89e619339e72968fc63a07c61b9f503aa453959325113a5639a87adc2"}
Jul 27 19:29:08.885923 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:08.885881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerStarted","Data":"7cfb32f85a1c54f8fde42d7a7ca047a3c71ac1eef1acf10307efb29f89001a94"}
Jul 27 19:29:08.886416 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:08.886027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerStarted","Data":"f94adac08c2c9f09a1421cc62917ebe36b0dde5855776688c38be0773bd5d539"}
Jul 27 19:29:08.886416 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:08.886075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerStarted","Data":"96f330c9b63943648d0937453e3dcd2d5b355b7dda3103abf69b3850718fbd15"}
Jul 27 19:29:08.886416 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:08.886113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerStarted","Data":"7cd645eb65665833700b7ec361d7dc7c22e65c95c953ec6e191b40b9f1f32b33"}
Jul 27 19:29:08.886416 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:08.886147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerStarted","Data":"c9de1ce45415fe735fb2da5c3224aac6d64fa9c1bd65f673c79bbdde7f6f747c"}
Jul 27 19:29:08.886416 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:08.886183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f6afd3b-27c1-4b60-b72d-9caff655bea9","Type":"ContainerStarted","Data":"5ad749757fe0f1c84fa9c70d44b19ad86c1d7d37efd0d15a44750de239d08bb9"}
Jul 27 19:29:08.923278 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:29:08.923224    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.907321586 podStartE2EDuration="2.92320919s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.887604ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:08.921378389 +0000 UTC m=+319.792565040" watchObservedRunningTime="2026-07-27 19:29:08.92320919 +0000 UTC m=+319.794395840"
Jul 27 19:30:07.969899 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:07.969857    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"]
Jul 27 19:30:07.973412 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:07.973390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:07.977043 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:07.977022    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 19:30:07.977168 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:07.977061    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 19:30:07.977168 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:07.977081    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l2dpv\""
Jul 27 19:30:07.983880 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:07.983861    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"]
Jul 27 19:30:08.078207 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.078176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h7js\" (UniqueName: \"kubernetes.io/projected/1c977ae1-0f73-4126-b277-26dd4090584e-kube-api-access-8h7js\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.078384 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.078219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.078384 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.078278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.179499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.179472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.179654 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.179526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h7js\" (UniqueName: \"kubernetes.io/projected/1c977ae1-0f73-4126-b277-26dd4090584e-kube-api-access-8h7js\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.179654 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.179564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.179858 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.179839    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.179986 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.179923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.190357 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.190336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h7js\" (UniqueName: \"kubernetes.io/projected/1c977ae1-0f73-4126-b277-26dd4090584e-kube-api-access-8h7js\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.282020 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.281928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:08.414244 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.414224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"]
Jul 27 19:30:08.416894 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:30:08.416867    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c977ae1_0f73_4126_b277_26dd4090584e.slice/crio-a8a7069e811f6831fc113a25168e22449763d13e13d447f36f40aad55cb52672 WatchSource:0}: Error finding container a8a7069e811f6831fc113a25168e22449763d13e13d447f36f40aad55cb52672: Status 404 returned error can't find the container with id a8a7069e811f6831fc113a25168e22449763d13e13d447f36f40aad55cb52672
Jul 27 19:30:08.418907 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:08.418886    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:30:09.117735 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:09.117699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42" event={"ID":"1c977ae1-0f73-4126-b277-26dd4090584e","Type":"ContainerStarted","Data":"a8a7069e811f6831fc113a25168e22449763d13e13d447f36f40aad55cb52672"}
Jul 27 19:30:15.145923 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:15.145884    2563 generic.go:356] "Generic (PLEG): container finished" podID="1c977ae1-0f73-4126-b277-26dd4090584e" containerID="77a26aac72c5a672ee80d0177880a9ab4917e74bf3276f717fa0c6c85ebe6afa" exitCode=0
Jul 27 19:30:15.146301 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:15.145991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42" event={"ID":"1c977ae1-0f73-4126-b277-26dd4090584e","Type":"ContainerDied","Data":"77a26aac72c5a672ee80d0177880a9ab4917e74bf3276f717fa0c6c85ebe6afa"}
Jul 27 19:30:25.186274 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:25.186190    2563 generic.go:356] "Generic (PLEG): container finished" podID="1c977ae1-0f73-4126-b277-26dd4090584e" containerID="5454cdc67e0715518dbaf57490979b92acd84c38b641df6a84c6f67db767d569" exitCode=0
Jul 27 19:30:25.186619 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:25.186280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42" event={"ID":"1c977ae1-0f73-4126-b277-26dd4090584e","Type":"ContainerDied","Data":"5454cdc67e0715518dbaf57490979b92acd84c38b641df6a84c6f67db767d569"}
Jul 27 19:30:33.224257 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:33.224221    2563 generic.go:356] "Generic (PLEG): container finished" podID="1c977ae1-0f73-4126-b277-26dd4090584e" containerID="660fd0d6323fac8f9f1fd48b12c4309e0f63313ddf639fce8fc766e798e453bc" exitCode=0
Jul 27 19:30:33.224257 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:33.224258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42" event={"ID":"1c977ae1-0f73-4126-b277-26dd4090584e","Type":"ContainerDied","Data":"660fd0d6323fac8f9f1fd48b12c4309e0f63313ddf639fce8fc766e798e453bc"}
Jul 27 19:30:34.359260 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.359238    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:34.513940 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.513857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-bundle\") pod \"1c977ae1-0f73-4126-b277-26dd4090584e\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") "
Jul 27 19:30:34.513940 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.513900    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h7js\" (UniqueName: \"kubernetes.io/projected/1c977ae1-0f73-4126-b277-26dd4090584e-kube-api-access-8h7js\") pod \"1c977ae1-0f73-4126-b277-26dd4090584e\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") "
Jul 27 19:30:34.513940 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.513939    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-util\") pod \"1c977ae1-0f73-4126-b277-26dd4090584e\" (UID: \"1c977ae1-0f73-4126-b277-26dd4090584e\") "
Jul 27 19:30:34.514510 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.514473    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-bundle" (OuterVolumeSpecName: "bundle") pod "1c977ae1-0f73-4126-b277-26dd4090584e" (UID: "1c977ae1-0f73-4126-b277-26dd4090584e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:34.516186 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.516163    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c977ae1-0f73-4126-b277-26dd4090584e-kube-api-access-8h7js" (OuterVolumeSpecName: "kube-api-access-8h7js") pod "1c977ae1-0f73-4126-b277-26dd4090584e" (UID: "1c977ae1-0f73-4126-b277-26dd4090584e"). InnerVolumeSpecName "kube-api-access-8h7js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:34.519039 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.519013    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-util" (OuterVolumeSpecName: "util") pod "1c977ae1-0f73-4126-b277-26dd4090584e" (UID: "1c977ae1-0f73-4126-b277-26dd4090584e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:34.615453 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.615422    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h7js\" (UniqueName: \"kubernetes.io/projected/1c977ae1-0f73-4126-b277-26dd4090584e-kube-api-access-8h7js\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:30:34.615453 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.615448    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-util\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:30:34.615453 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:34.615456    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c977ae1-0f73-4126-b277-26dd4090584e-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:30:35.234483 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:35.234454    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42"
Jul 27 19:30:35.234483 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:35.234469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hxc42" event={"ID":"1c977ae1-0f73-4126-b277-26dd4090584e","Type":"ContainerDied","Data":"a8a7069e811f6831fc113a25168e22449763d13e13d447f36f40aad55cb52672"}
Jul 27 19:30:35.234732 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:35.234509    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8a7069e811f6831fc113a25168e22449763d13e13d447f36f40aad55cb52672"
Jul 27 19:30:40.869197 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869165    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"]
Jul 27 19:30:40.869660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c977ae1-0f73-4126-b277-26dd4090584e" containerName="pull"
Jul 27 19:30:40.869660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869490    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c977ae1-0f73-4126-b277-26dd4090584e" containerName="pull"
Jul 27 19:30:40.869660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869503    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c977ae1-0f73-4126-b277-26dd4090584e" containerName="util"
Jul 27 19:30:40.869660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869508    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c977ae1-0f73-4126-b277-26dd4090584e" containerName="util"
Jul 27 19:30:40.869660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869514    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c977ae1-0f73-4126-b277-26dd4090584e" containerName="extract"
Jul 27 19:30:40.869660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869519    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c977ae1-0f73-4126-b277-26dd4090584e" containerName="extract"
Jul 27 19:30:40.869660 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.869566    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c977ae1-0f73-4126-b277-26dd4090584e" containerName="extract"
Jul 27 19:30:40.871481 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.871466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:40.874296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.874275    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 19:30:40.874423 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.874326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-r56z9\""
Jul 27 19:30:40.874423 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.874379    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:30:40.886135 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:40.886112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"]
Jul 27 19:30:41.067620 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.067580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba6e8af1-9c57-4ce5-92e4-90d5dff4960e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wx69m\" (UID: \"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:41.067794 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.067636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmqxh\" (UniqueName: \"kubernetes.io/projected/ba6e8af1-9c57-4ce5-92e4-90d5dff4960e-kube-api-access-fmqxh\") pod \"cert-manager-operator-controller-manager-55c444bf86-wx69m\" (UID: \"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:41.168520 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.168445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba6e8af1-9c57-4ce5-92e4-90d5dff4960e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wx69m\" (UID: \"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:41.168520 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.168493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmqxh\" (UniqueName: \"kubernetes.io/projected/ba6e8af1-9c57-4ce5-92e4-90d5dff4960e-kube-api-access-fmqxh\") pod \"cert-manager-operator-controller-manager-55c444bf86-wx69m\" (UID: \"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:41.168819 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.168800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba6e8af1-9c57-4ce5-92e4-90d5dff4960e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wx69m\" (UID: \"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:41.181826 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.181806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmqxh\" (UniqueName: \"kubernetes.io/projected/ba6e8af1-9c57-4ce5-92e4-90d5dff4960e-kube-api-access-fmqxh\") pod \"cert-manager-operator-controller-manager-55c444bf86-wx69m\" (UID: \"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:41.480760 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.480667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"
Jul 27 19:30:41.623282 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:41.623258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m"]
Jul 27 19:30:41.625289 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:30:41.625251    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba6e8af1_9c57_4ce5_92e4_90d5dff4960e.slice/crio-aa4af1bde45f0b6fed54ed5dda15ca83ea557fe1272517bbd884cf4654a8d5e3 WatchSource:0}: Error finding container aa4af1bde45f0b6fed54ed5dda15ca83ea557fe1272517bbd884cf4654a8d5e3: Status 404 returned error can't find the container with id aa4af1bde45f0b6fed54ed5dda15ca83ea557fe1272517bbd884cf4654a8d5e3
Jul 27 19:30:42.269088 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:42.269051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m" event={"ID":"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e","Type":"ContainerStarted","Data":"aa4af1bde45f0b6fed54ed5dda15ca83ea557fe1272517bbd884cf4654a8d5e3"}
Jul 27 19:30:44.280397 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.280362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m" event={"ID":"ba6e8af1-9c57-4ce5-92e4-90d5dff4960e","Type":"ContainerStarted","Data":"1b5654f85cfd1394f637ae7370eed420446629c078716a1f507107429d8162c0"}
Jul 27 19:30:44.302607 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.302553    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wx69m" podStartSLOduration=2.59940645 podStartE2EDuration="4.302538592s" totalImagesPullingTime="1.703132142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:44.300507062 +0000 UTC m=+415.171693711" watchObservedRunningTime="2026-07-27 19:30:44.302538592 +0000 UTC m=+415.173725242"
Jul 27 19:30:44.605470 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.605432    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v8tdw"]
Jul 27 19:30:44.607794 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.607776    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:44.614231 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.614208    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 19:30:44.614337 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.614305    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nccdp\""
Jul 27 19:30:44.614413 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.614396    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 19:30:44.626567 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.626546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v8tdw"]
Jul 27 19:30:44.696668 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.696632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx6lx\" (UniqueName: \"kubernetes.io/projected/3648946b-0804-41ff-9aa6-9d4bc41da743-kube-api-access-tx6lx\") pod \"cert-manager-webhook-6486ffd997-v8tdw\" (UID: \"3648946b-0804-41ff-9aa6-9d4bc41da743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:44.696833 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.696691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3648946b-0804-41ff-9aa6-9d4bc41da743-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v8tdw\" (UID: \"3648946b-0804-41ff-9aa6-9d4bc41da743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:44.797997 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.797962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3648946b-0804-41ff-9aa6-9d4bc41da743-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v8tdw\" (UID: \"3648946b-0804-41ff-9aa6-9d4bc41da743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:44.798171 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.798083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx6lx\" (UniqueName: \"kubernetes.io/projected/3648946b-0804-41ff-9aa6-9d4bc41da743-kube-api-access-tx6lx\") pod \"cert-manager-webhook-6486ffd997-v8tdw\" (UID: \"3648946b-0804-41ff-9aa6-9d4bc41da743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:44.811328 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.811294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3648946b-0804-41ff-9aa6-9d4bc41da743-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-v8tdw\" (UID: \"3648946b-0804-41ff-9aa6-9d4bc41da743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:44.812653 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.812629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx6lx\" (UniqueName: \"kubernetes.io/projected/3648946b-0804-41ff-9aa6-9d4bc41da743-kube-api-access-tx6lx\") pod \"cert-manager-webhook-6486ffd997-v8tdw\" (UID: \"3648946b-0804-41ff-9aa6-9d4bc41da743\") " pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:44.931485 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:44.931398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:45.067893 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.067857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-v8tdw"]
Jul 27 19:30:45.070348 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:30:45.070315    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3648946b_0804_41ff_9aa6_9d4bc41da743.slice/crio-854041e251636d463490bd906b74615bea24cfd5d7defd525bbfedab19591524 WatchSource:0}: Error finding container 854041e251636d463490bd906b74615bea24cfd5d7defd525bbfedab19591524: Status 404 returned error can't find the container with id 854041e251636d463490bd906b74615bea24cfd5d7defd525bbfedab19591524
Jul 27 19:30:45.286067 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.285977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw" event={"ID":"3648946b-0804-41ff-9aa6-9d4bc41da743","Type":"ContainerStarted","Data":"854041e251636d463490bd906b74615bea24cfd5d7defd525bbfedab19591524"}
Jul 27 19:30:45.329187 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.329158    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"]
Jul 27 19:30:45.332593 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.332574    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.335476 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.335461    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 19:30:45.335476 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.335464    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 19:30:45.336675 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.336655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l2dpv\""
Jul 27 19:30:45.341543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.341521    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"]
Jul 27 19:30:45.402958 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.402924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnlk5\" (UniqueName: \"kubernetes.io/projected/f87fa2de-1fde-4343-ace0-be4992ec9d86-kube-api-access-cnlk5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.403127 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.402976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.403127 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.403034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.504024 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.503990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnlk5\" (UniqueName: \"kubernetes.io/projected/f87fa2de-1fde-4343-ace0-be4992ec9d86-kube-api-access-cnlk5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.504024 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.504031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.504290 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.504151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.504390 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.504372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.504445 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.504419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.514649 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.514625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnlk5\" (UniqueName: \"kubernetes.io/projected/f87fa2de-1fde-4343-ace0-be4992ec9d86-kube-api-access-cnlk5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.642279 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.642241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:45.776085 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:45.776054    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"]
Jul 27 19:30:45.779291 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:30:45.779261    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87fa2de_1fde_4343_ace0_be4992ec9d86.slice/crio-d632dc84d71b68b0c0b101bb802060f3fafb50f0a0726ca603a2b192f573d7c0 WatchSource:0}: Error finding container d632dc84d71b68b0c0b101bb802060f3fafb50f0a0726ca603a2b192f573d7c0: Status 404 returned error can't find the container with id d632dc84d71b68b0c0b101bb802060f3fafb50f0a0726ca603a2b192f573d7c0
Jul 27 19:30:46.292687 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.292659    2563 generic.go:356] "Generic (PLEG): container finished" podID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerID="7f15015d7f6f960ab1175b9e58de43f2a0658c608c5b957f309a596fe78b7ff6" exitCode=0
Jul 27 19:30:46.293057 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.292704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7" event={"ID":"f87fa2de-1fde-4343-ace0-be4992ec9d86","Type":"ContainerDied","Data":"7f15015d7f6f960ab1175b9e58de43f2a0658c608c5b957f309a596fe78b7ff6"}
Jul 27 19:30:46.293057 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.292740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7" event={"ID":"f87fa2de-1fde-4343-ace0-be4992ec9d86","Type":"ContainerStarted","Data":"d632dc84d71b68b0c0b101bb802060f3fafb50f0a0726ca603a2b192f573d7c0"}
Jul 27 19:30:46.857019 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.856980    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"]
Jul 27 19:30:46.859494 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.859470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:46.862388 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.862357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9bt49\""
Jul 27 19:30:46.870654 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.870626    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"]
Jul 27 19:30:46.916115 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.916080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zgbh\" (UniqueName: \"kubernetes.io/projected/ab7d34fa-2428-42f5-9a95-d682ccba35dc-kube-api-access-6zgbh\") pod \"cert-manager-cainjector-559cdd8c87-46lc2\" (UID: \"ab7d34fa-2428-42f5-9a95-d682ccba35dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:46.916300 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:46.916143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab7d34fa-2428-42f5-9a95-d682ccba35dc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-46lc2\" (UID: \"ab7d34fa-2428-42f5-9a95-d682ccba35dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:47.016612 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:47.016581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zgbh\" (UniqueName: \"kubernetes.io/projected/ab7d34fa-2428-42f5-9a95-d682ccba35dc-kube-api-access-6zgbh\") pod \"cert-manager-cainjector-559cdd8c87-46lc2\" (UID: \"ab7d34fa-2428-42f5-9a95-d682ccba35dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:47.016612 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:47.016622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab7d34fa-2428-42f5-9a95-d682ccba35dc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-46lc2\" (UID: \"ab7d34fa-2428-42f5-9a95-d682ccba35dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:47.029413 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:47.029370    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab7d34fa-2428-42f5-9a95-d682ccba35dc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-46lc2\" (UID: \"ab7d34fa-2428-42f5-9a95-d682ccba35dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:47.031818 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:47.031793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zgbh\" (UniqueName: \"kubernetes.io/projected/ab7d34fa-2428-42f5-9a95-d682ccba35dc-kube-api-access-6zgbh\") pod \"cert-manager-cainjector-559cdd8c87-46lc2\" (UID: \"ab7d34fa-2428-42f5-9a95-d682ccba35dc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:47.170542 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:47.170453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"
Jul 27 19:30:47.946567 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:47.946536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-46lc2"]
Jul 27 19:30:47.950027 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:30:47.949997    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab7d34fa_2428_42f5_9a95_d682ccba35dc.slice/crio-73ce87f95dbdf4a278aa4d3ef6ddc482766c412a2d24a8fef525633cb5beae69 WatchSource:0}: Error finding container 73ce87f95dbdf4a278aa4d3ef6ddc482766c412a2d24a8fef525633cb5beae69: Status 404 returned error can't find the container with id 73ce87f95dbdf4a278aa4d3ef6ddc482766c412a2d24a8fef525633cb5beae69
Jul 27 19:30:48.305120 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:48.305082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw" event={"ID":"3648946b-0804-41ff-9aa6-9d4bc41da743","Type":"ContainerStarted","Data":"70915f1e631aa8db41d90bd2b1c5d5d437cfc6e33068f57bb0db4af955052bf4"}
Jul 27 19:30:48.305285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:48.305167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:48.307011 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:48.306980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2" event={"ID":"ab7d34fa-2428-42f5-9a95-d682ccba35dc","Type":"ContainerStarted","Data":"3edd5f40ccde0f5bf199e5584d8bad50a7122d2b70ce9c521e15557c58147899"}
Jul 27 19:30:48.307149 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:48.307017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2" event={"ID":"ab7d34fa-2428-42f5-9a95-d682ccba35dc","Type":"ContainerStarted","Data":"73ce87f95dbdf4a278aa4d3ef6ddc482766c412a2d24a8fef525633cb5beae69"}
Jul 27 19:30:48.325897 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:48.325856    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw" podStartSLOduration=1.546563886 podStartE2EDuration="4.325842273s" totalImagesPullingTime="2.779278387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:48.324414613 +0000 UTC m=+419.195601280" watchObservedRunningTime="2026-07-27 19:30:48.325842273 +0000 UTC m=+419.197028922"
Jul 27 19:30:48.345135 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:48.345092    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-46lc2" podStartSLOduration=2.3450791779999998 podStartE2EDuration="2.345079178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:48.344292542 +0000 UTC m=+419.215479192" watchObservedRunningTime="2026-07-27 19:30:48.345079178 +0000 UTC m=+419.216265827"
Jul 27 19:30:51.323522 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:51.323486    2563 generic.go:356] "Generic (PLEG): container finished" podID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerID="838c130c01119e5af7a64abf31aa06d5fc96182188b1dcf018498485ac8a02e5" exitCode=0
Jul 27 19:30:51.323895 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:51.323574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7" event={"ID":"f87fa2de-1fde-4343-ace0-be4992ec9d86","Type":"ContainerDied","Data":"838c130c01119e5af7a64abf31aa06d5fc96182188b1dcf018498485ac8a02e5"}
Jul 27 19:30:52.330536 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:52.330501    2563 generic.go:356] "Generic (PLEG): container finished" podID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerID="64c2c6731447b30f5a8c17915e3e5e5669839dc1551d3926a713555ec33c445e" exitCode=0
Jul 27 19:30:52.331074 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:52.330567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7" event={"ID":"f87fa2de-1fde-4343-ace0-be4992ec9d86","Type":"ContainerDied","Data":"64c2c6731447b30f5a8c17915e3e5e5669839dc1551d3926a713555ec33c445e"}
Jul 27 19:30:53.465287 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.465262    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:53.563579 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.563544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-bundle\") pod \"f87fa2de-1fde-4343-ace0-be4992ec9d86\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") "
Jul 27 19:30:53.563756 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.563642    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-util\") pod \"f87fa2de-1fde-4343-ace0-be4992ec9d86\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") "
Jul 27 19:30:53.563756 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.563674    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnlk5\" (UniqueName: \"kubernetes.io/projected/f87fa2de-1fde-4343-ace0-be4992ec9d86-kube-api-access-cnlk5\") pod \"f87fa2de-1fde-4343-ace0-be4992ec9d86\" (UID: \"f87fa2de-1fde-4343-ace0-be4992ec9d86\") "
Jul 27 19:30:53.563935 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.563917    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-bundle" (OuterVolumeSpecName: "bundle") pod "f87fa2de-1fde-4343-ace0-be4992ec9d86" (UID: "f87fa2de-1fde-4343-ace0-be4992ec9d86"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:53.566235 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.566211    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87fa2de-1fde-4343-ace0-be4992ec9d86-kube-api-access-cnlk5" (OuterVolumeSpecName: "kube-api-access-cnlk5") pod "f87fa2de-1fde-4343-ace0-be4992ec9d86" (UID: "f87fa2de-1fde-4343-ace0-be4992ec9d86"). InnerVolumeSpecName "kube-api-access-cnlk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:30:53.568785 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.568745    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-util" (OuterVolumeSpecName: "util") pod "f87fa2de-1fde-4343-ace0-be4992ec9d86" (UID: "f87fa2de-1fde-4343-ace0-be4992ec9d86"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:30:53.664835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.664800    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-util\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:30:53.664835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.664827    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnlk5\" (UniqueName: \"kubernetes.io/projected/f87fa2de-1fde-4343-ace0-be4992ec9d86-kube-api-access-cnlk5\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:30:53.664835 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:53.664841    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87fa2de-1fde-4343-ace0-be4992ec9d86-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:30:54.314612 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:54.314578    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-v8tdw"
Jul 27 19:30:54.342571 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:54.342534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7" event={"ID":"f87fa2de-1fde-4343-ace0-be4992ec9d86","Type":"ContainerDied","Data":"d632dc84d71b68b0c0b101bb802060f3fafb50f0a0726ca603a2b192f573d7c0"}
Jul 27 19:30:54.342746 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:54.342578    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpghj7"
Jul 27 19:30:54.342746 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:54.342590    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d632dc84d71b68b0c0b101bb802060f3fafb50f0a0726ca603a2b192f573d7c0"
Jul 27 19:30:56.171867 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.171839    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f4lfr"]
Jul 27 19:30:56.172285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.172165    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerName="util"
Jul 27 19:30:56.172285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.172176    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerName="util"
Jul 27 19:30:56.172285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.172184    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerName="pull"
Jul 27 19:30:56.172285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.172190    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerName="pull"
Jul 27 19:30:56.172285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.172202    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerName="extract"
Jul 27 19:30:56.172285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.172207    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerName="extract"
Jul 27 19:30:56.172285 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.172256    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f87fa2de-1fde-4343-ace0-be4992ec9d86" containerName="extract"
Jul 27 19:30:56.174413 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.174397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.177009 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.176991    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bwxs7\""
Jul 27 19:30:56.180487 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.180466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/092b9511-941a-47cb-88cc-ea1d88d551ba-bound-sa-token\") pod \"cert-manager-55b4d954d5-f4lfr\" (UID: \"092b9511-941a-47cb-88cc-ea1d88d551ba\") " pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.180587 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.180506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv8t6\" (UniqueName: \"kubernetes.io/projected/092b9511-941a-47cb-88cc-ea1d88d551ba-kube-api-access-sv8t6\") pod \"cert-manager-55b4d954d5-f4lfr\" (UID: \"092b9511-941a-47cb-88cc-ea1d88d551ba\") " pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.186097 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.186077    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f4lfr"]
Jul 27 19:30:56.281243 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.281196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/092b9511-941a-47cb-88cc-ea1d88d551ba-bound-sa-token\") pod \"cert-manager-55b4d954d5-f4lfr\" (UID: \"092b9511-941a-47cb-88cc-ea1d88d551ba\") " pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.281391 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.281268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv8t6\" (UniqueName: \"kubernetes.io/projected/092b9511-941a-47cb-88cc-ea1d88d551ba-kube-api-access-sv8t6\") pod \"cert-manager-55b4d954d5-f4lfr\" (UID: \"092b9511-941a-47cb-88cc-ea1d88d551ba\") " pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.291121 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.291099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/092b9511-941a-47cb-88cc-ea1d88d551ba-bound-sa-token\") pod \"cert-manager-55b4d954d5-f4lfr\" (UID: \"092b9511-941a-47cb-88cc-ea1d88d551ba\") " pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.291121 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.291120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv8t6\" (UniqueName: \"kubernetes.io/projected/092b9511-941a-47cb-88cc-ea1d88d551ba-kube-api-access-sv8t6\") pod \"cert-manager-55b4d954d5-f4lfr\" (UID: \"092b9511-941a-47cb-88cc-ea1d88d551ba\") " pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.483184 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.483080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-f4lfr"
Jul 27 19:30:56.619388 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:56.619356    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-f4lfr"]
Jul 27 19:30:56.623778 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:30:56.623753    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod092b9511_941a_47cb_88cc_ea1d88d551ba.slice/crio-6aee3b9421456fdb5ef1fb7d5ed2c66b0c3a6a676fe9f24e3f14d21aecd3dcb2 WatchSource:0}: Error finding container 6aee3b9421456fdb5ef1fb7d5ed2c66b0c3a6a676fe9f24e3f14d21aecd3dcb2: Status 404 returned error can't find the container with id 6aee3b9421456fdb5ef1fb7d5ed2c66b0c3a6a676fe9f24e3f14d21aecd3dcb2
Jul 27 19:30:57.356090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:57.356058    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f4lfr" event={"ID":"092b9511-941a-47cb-88cc-ea1d88d551ba","Type":"ContainerStarted","Data":"da20f1fdf5c5cde0e84f3074786167b25e8631da6718de6fd353e52091ba8d84"}
Jul 27 19:30:57.356090 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:57.356097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-f4lfr" event={"ID":"092b9511-941a-47cb-88cc-ea1d88d551ba","Type":"ContainerStarted","Data":"6aee3b9421456fdb5ef1fb7d5ed2c66b0c3a6a676fe9f24e3f14d21aecd3dcb2"}
Jul 27 19:30:57.375427 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:30:57.375357    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-f4lfr" podStartSLOduration=1.375341945 podStartE2EDuration="1.375341945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:57.373197092 +0000 UTC m=+428.244383754" watchObservedRunningTime="2026-07-27 19:30:57.375341945 +0000 UTC m=+428.246528594"
Jul 27 19:31:10.094194 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.094098    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"]
Jul 27 19:31:10.100054 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.100024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.103483 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.103464    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 19:31:10.103724 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.103709    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l2dpv\""
Jul 27 19:31:10.104731 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.104712    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 19:31:10.130084 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.130062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"]
Jul 27 19:31:10.179005 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.178977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2ps\" (UniqueName: \"kubernetes.io/projected/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-kube-api-access-wx2ps\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.179165 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.179019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.179165 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.179065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.280348 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.280309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2ps\" (UniqueName: \"kubernetes.io/projected/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-kube-api-access-wx2ps\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.280511 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.280360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.280511 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.280431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.280736 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.280721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.280781 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.280763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.292743 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.292715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2ps\" (UniqueName: \"kubernetes.io/projected/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-kube-api-access-wx2ps\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.409669 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.409573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:10.549850 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:10.549822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"]
Jul 27 19:31:10.550881 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:31:10.550857    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7f500c_6a9c_4d63_b2ee_c7a3722c01cb.slice/crio-e3c4de543b33de3c4c67e624dae540120169e5dfa1eb1052d8f914a192ea317a WatchSource:0}: Error finding container e3c4de543b33de3c4c67e624dae540120169e5dfa1eb1052d8f914a192ea317a: Status 404 returned error can't find the container with id e3c4de543b33de3c4c67e624dae540120169e5dfa1eb1052d8f914a192ea317a
Jul 27 19:31:11.421152 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:11.421116    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerID="f84c58aebd9d1445c33fb3f38cf6dba89e4a0d85c5a1e14e029713c5f7c4a193" exitCode=0
Jul 27 19:31:11.421615 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:11.421206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz" event={"ID":"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb","Type":"ContainerDied","Data":"f84c58aebd9d1445c33fb3f38cf6dba89e4a0d85c5a1e14e029713c5f7c4a193"}
Jul 27 19:31:11.421615 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:11.421255    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz" event={"ID":"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb","Type":"ContainerStarted","Data":"e3c4de543b33de3c4c67e624dae540120169e5dfa1eb1052d8f914a192ea317a"}
Jul 27 19:31:12.431674 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:12.431628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz" event={"ID":"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb","Type":"ContainerStarted","Data":"c8829edf49362503f1dadfc6117083a13a90462a86585af60331596c892d1b33"}
Jul 27 19:31:13.437304 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:13.437264    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerID="c8829edf49362503f1dadfc6117083a13a90462a86585af60331596c892d1b33" exitCode=0
Jul 27 19:31:13.437690 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:13.437317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz" event={"ID":"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb","Type":"ContainerDied","Data":"c8829edf49362503f1dadfc6117083a13a90462a86585af60331596c892d1b33"}
Jul 27 19:31:14.443937 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:14.443903    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerID="f4233c09f2231c326eb70415b34d67b7124a2ee08a7f8215274dc6c4f27914cf" exitCode=0
Jul 27 19:31:14.444348 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:14.443993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz" event={"ID":"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb","Type":"ContainerDied","Data":"f4233c09f2231c326eb70415b34d67b7124a2ee08a7f8215274dc6c4f27914cf"}
Jul 27 19:31:15.572137 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.572115    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:15.624303 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.624279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-bundle\") pod \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") "
Jul 27 19:31:15.624443 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.624351    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx2ps\" (UniqueName: \"kubernetes.io/projected/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-kube-api-access-wx2ps\") pod \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") "
Jul 27 19:31:15.624443 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.624432    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-util\") pod \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\" (UID: \"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb\") "
Jul 27 19:31:15.625187 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.625161    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-bundle" (OuterVolumeSpecName: "bundle") pod "4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" (UID: "4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:31:15.626524 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.626496    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-kube-api-access-wx2ps" (OuterVolumeSpecName: "kube-api-access-wx2ps") pod "4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" (UID: "4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb"). InnerVolumeSpecName "kube-api-access-wx2ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:31:15.630216 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.630193    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-util" (OuterVolumeSpecName: "util") pod "4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" (UID: "4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:31:15.725706 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.725628    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-util\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:31:15.725706 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.725664    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:31:15.725706 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:15.725674    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx2ps\" (UniqueName: \"kubernetes.io/projected/4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb-kube-api-access-wx2ps\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:31:16.454514 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:16.454482    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz"
Jul 27 19:31:16.454514 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:16.454510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affb9kz" event={"ID":"4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb","Type":"ContainerDied","Data":"e3c4de543b33de3c4c67e624dae540120169e5dfa1eb1052d8f914a192ea317a"}
Jul 27 19:31:16.454720 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:16.454557    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3c4de543b33de3c4c67e624dae540120169e5dfa1eb1052d8f914a192ea317a"
Jul 27 19:31:18.351400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351365    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"]
Jul 27 19:31:18.351779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351686    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerName="extract"
Jul 27 19:31:18.351779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351696    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerName="extract"
Jul 27 19:31:18.351779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351712    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerName="pull"
Jul 27 19:31:18.351779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351718    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerName="pull"
Jul 27 19:31:18.351779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351726    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerName="util"
Jul 27 19:31:18.351779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351731    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerName="util"
Jul 27 19:31:18.351991 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.351783    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d7f500c-6a9c-4d63-b2ee-c7a3722c01cb" containerName="extract"
Jul 27 19:31:18.353904 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.353884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.358120 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.358099    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 19:31:18.359394 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.359377    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:31:18.359491 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.359454    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:31:18.359491 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.359395    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 19:31:18.360847 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.360826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-thxqs\""
Jul 27 19:31:18.360971 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.360933    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 19:31:18.375776 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.375748    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"]
Jul 27 19:31:18.449023 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.448982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-metrics-cert\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.449200 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.449048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-cert\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.449200 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.449081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-manager-config\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.449200 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.449109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5597m\" (UniqueName: \"kubernetes.io/projected/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-kube-api-access-5597m\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.550339 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.550301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-metrics-cert\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.550545 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.550359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-cert\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.550545 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.550380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-manager-config\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.550545 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.550451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5597m\" (UniqueName: \"kubernetes.io/projected/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-kube-api-access-5597m\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.551053 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.551027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-manager-config\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.553027 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.553011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-cert\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.553244 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.553224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-metrics-cert\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.563027 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.562995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5597m\" (UniqueName: \"kubernetes.io/projected/3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7-kube-api-access-5597m\") pod \"lws-controller-manager-776dc7b77-scdmd\" (UID: \"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7\") " pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.662895 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.662810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:18.802676 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:18.802641    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"]
Jul 27 19:31:18.804974 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:31:18.804921    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8cc61d_3857_4f55_b9aa_f49cbe9dabd7.slice/crio-5f0fb5a5df7abddff5317adfb02a9a99da8a04d0ce87c6ae1233e883b57c7537 WatchSource:0}: Error finding container 5f0fb5a5df7abddff5317adfb02a9a99da8a04d0ce87c6ae1233e883b57c7537: Status 404 returned error can't find the container with id 5f0fb5a5df7abddff5317adfb02a9a99da8a04d0ce87c6ae1233e883b57c7537
Jul 27 19:31:19.468995 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:19.468963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd" event={"ID":"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7","Type":"ContainerStarted","Data":"5f0fb5a5df7abddff5317adfb02a9a99da8a04d0ce87c6ae1233e883b57c7537"}
Jul 27 19:31:22.487795 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:22.487764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd" event={"ID":"3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7","Type":"ContainerStarted","Data":"3ef18a28133bb73ff515c419df4204bf4786331057682ae7a48f1d4057a3fe69"}
Jul 27 19:31:22.488211 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:22.487825    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:22.509293 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:22.509238    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd" podStartSLOduration=1.474389542 podStartE2EDuration="4.509218262s" totalImagesPullingTime="3.03482872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:22.507616641 +0000 UTC m=+453.378803290" watchObservedRunningTime="2026-07-27 19:31:22.509218262 +0000 UTC m=+453.380404913"
Jul 27 19:31:26.468022 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.467972    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"]
Jul 27 19:31:26.471528 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.471508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.474514 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.474487    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:31:26.474644 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.474513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:31:26.474644 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.474487    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tw2cw\""
Jul 27 19:31:26.474644 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.474604    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:31:26.474963 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.474929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:31:26.487663 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.487631    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"]
Jul 27 19:31:26.520775 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.520741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.520775 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.520773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-manifests\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.521015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.520793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-tmp\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.521015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.520879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.521015 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.520922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72cpz\" (UniqueName: \"kubernetes.io/projected/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-kube-api-access-72cpz\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.621886 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.621849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.621886 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.621887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-manifests\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.622139 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.621904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-tmp\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.622139 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.621938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.622139 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.621991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72cpz\" (UniqueName: \"kubernetes.io/projected/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-kube-api-access-72cpz\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.622348 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.622324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-manifests\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.624572 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.624541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-tmp\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.624682 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.624664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.624771 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.624749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.632709 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.632684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72cpz\" (UniqueName: \"kubernetes.io/projected/3152e050-5e5b-4a85-a15b-b4fa3eb53e6a-kube-api-access-72cpz\") pod \"opendatahub-operator-controller-manager-6c5c9bc998-tnjpm\" (UID: \"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.782911 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.782828    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:26.929133 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:26.929105    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"]
Jul 27 19:31:26.931874 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:31:26.931846    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3152e050_5e5b_4a85_a15b_b4fa3eb53e6a.slice/crio-2120d31b7409899c37f3e450b1c856db45c5c825c7f5d6986aa3173468f493e7 WatchSource:0}: Error finding container 2120d31b7409899c37f3e450b1c856db45c5c825c7f5d6986aa3173468f493e7: Status 404 returned error can't find the container with id 2120d31b7409899c37f3e450b1c856db45c5c825c7f5d6986aa3173468f493e7
Jul 27 19:31:27.512159 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:27.512125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm" event={"ID":"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a","Type":"ContainerStarted","Data":"2120d31b7409899c37f3e450b1c856db45c5c825c7f5d6986aa3173468f493e7"}
Jul 27 19:31:30.529129 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:30.529096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm" event={"ID":"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a","Type":"ContainerStarted","Data":"2796a55c96586360fc3806579a50b67b6f1894bd2d41b7a69e929a235d30fa7e"}
Jul 27 19:31:31.535400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:31.535362    2563 generic.go:356] "Generic (PLEG): container finished" podID="3152e050-5e5b-4a85-a15b-b4fa3eb53e6a" containerID="2796a55c96586360fc3806579a50b67b6f1894bd2d41b7a69e929a235d30fa7e" exitCode=0
Jul 27 19:31:31.535796 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:31.535443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm" event={"ID":"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a","Type":"ContainerDied","Data":"2796a55c96586360fc3806579a50b67b6f1894bd2d41b7a69e929a235d30fa7e"}
Jul 27 19:31:32.543805 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:32.543772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm" event={"ID":"3152e050-5e5b-4a85-a15b-b4fa3eb53e6a","Type":"ContainerStarted","Data":"5c2c4aa55d2c590712f1a2f4c8951c77c5d1b1732d13fd29bc9419d345b31735"}
Jul 27 19:31:32.544198 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:32.543962    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:32.571461 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:32.571413    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm" podStartSLOduration=2.105245446 podStartE2EDuration="6.571397317s" totalImagesPullingTime="3.46353898s" totalInitContainerRuntime="1.002612891s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:32.569139355 +0000 UTC m=+463.440326006" watchObservedRunningTime="2026-07-27 19:31:32.571397317 +0000 UTC m=+463.442583967"
Jul 27 19:31:33.495358 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:33.495327    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-776dc7b77-scdmd"
Jul 27 19:31:43.554031 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:43.553998    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c5c9bc998-tnjpm"
Jul 27 19:31:47.888011 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:47.887975    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fdw84"]
Jul 27 19:31:47.894859 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:47.894833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:47.903806 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:47.903774    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 19:31:47.907337 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:47.907311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fdw84"]
Jul 27 19:31:48.019131 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.019081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bn5l\" (UniqueName: \"kubernetes.io/projected/331276c3-c4be-40d2-a738-686fcbf900ec-kube-api-access-6bn5l\") pod \"model-serving-api-54d89bd5fc-fdw84\" (UID: \"331276c3-c4be-40d2-a738-686fcbf900ec\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:48.019304 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.019147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/331276c3-c4be-40d2-a738-686fcbf900ec-tls-certs\") pod \"model-serving-api-54d89bd5fc-fdw84\" (UID: \"331276c3-c4be-40d2-a738-686fcbf900ec\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:48.119786 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.119750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/331276c3-c4be-40d2-a738-686fcbf900ec-tls-certs\") pod \"model-serving-api-54d89bd5fc-fdw84\" (UID: \"331276c3-c4be-40d2-a738-686fcbf900ec\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:48.120013 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.119874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bn5l\" (UniqueName: \"kubernetes.io/projected/331276c3-c4be-40d2-a738-686fcbf900ec-kube-api-access-6bn5l\") pod \"model-serving-api-54d89bd5fc-fdw84\" (UID: \"331276c3-c4be-40d2-a738-686fcbf900ec\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:48.122613 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.122585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/331276c3-c4be-40d2-a738-686fcbf900ec-tls-certs\") pod \"model-serving-api-54d89bd5fc-fdw84\" (UID: \"331276c3-c4be-40d2-a738-686fcbf900ec\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:48.129414 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.129384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bn5l\" (UniqueName: \"kubernetes.io/projected/331276c3-c4be-40d2-a738-686fcbf900ec-kube-api-access-6bn5l\") pod \"model-serving-api-54d89bd5fc-fdw84\" (UID: \"331276c3-c4be-40d2-a738-686fcbf900ec\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:48.213938 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.213845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:48.360151 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.360125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fdw84"]
Jul 27 19:31:48.363361 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:31:48.363322    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331276c3_c4be_40d2_a738_686fcbf900ec.slice/crio-1b79c921626bcbb1fbeddaa92f51e57e246155a887dcb1ed114a536f94937c5c WatchSource:0}: Error finding container 1b79c921626bcbb1fbeddaa92f51e57e246155a887dcb1ed114a536f94937c5c: Status 404 returned error can't find the container with id 1b79c921626bcbb1fbeddaa92f51e57e246155a887dcb1ed114a536f94937c5c
Jul 27 19:31:48.627371 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:48.627335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fdw84" event={"ID":"331276c3-c4be-40d2-a738-686fcbf900ec","Type":"ContainerStarted","Data":"1b79c921626bcbb1fbeddaa92f51e57e246155a887dcb1ed114a536f94937c5c"}
Jul 27 19:31:50.643392 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:50.643351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fdw84" event={"ID":"331276c3-c4be-40d2-a738-686fcbf900ec","Type":"ContainerStarted","Data":"9c473397f5f5f99fee10e8c5218e408fbeae768fa90e21f05023dd6a144b4a62"}
Jul 27 19:31:50.643838 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:50.643506    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:31:50.665117 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:50.665062    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fdw84" podStartSLOduration=1.990484694 podStartE2EDuration="3.665045543s" totalImagesPullingTime="1.674560849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:50.663023964 +0000 UTC m=+481.534210639" watchObservedRunningTime="2026-07-27 19:31:50.665045543 +0000 UTC m=+481.536232193"
Jul 27 19:31:54.385297 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.385263    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"]
Jul 27 19:31:54.387811 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.387795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.390664 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.390637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 19:31:54.390788 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.390638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 19:31:54.390788 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.390649    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:31:54.390788 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.390654    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-slprz\""
Jul 27 19:31:54.391007 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.390982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 19:31:54.391007 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.390993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 19:31:54.391160 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.391140    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:31:54.404145 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.404126    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"]
Jul 27 19:31:54.585738 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.585700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.585907 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.585778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c973d079-0040-49cb-937f-b7e245df7cd9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.585907 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.585824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c973d079-0040-49cb-937f-b7e245df7cd9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.585907 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.585889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftkdc\" (UniqueName: \"kubernetes.io/projected/c973d079-0040-49cb-937f-b7e245df7cd9-kube-api-access-ftkdc\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.586060 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.585979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.586060 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.586025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c973d079-0040-49cb-937f-b7e245df7cd9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.586060 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.586055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.687400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.687310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c973d079-0040-49cb-937f-b7e245df7cd9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.687400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.687349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.687400 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.687379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.687622 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.687504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c973d079-0040-49cb-937f-b7e245df7cd9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.687622 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.687546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c973d079-0040-49cb-937f-b7e245df7cd9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.687708 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.687671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftkdc\" (UniqueName: \"kubernetes.io/projected/c973d079-0040-49cb-937f-b7e245df7cd9-kube-api-access-ftkdc\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.687794 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.687772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.688460 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.688436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c973d079-0040-49cb-937f-b7e245df7cd9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.689985 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.689938    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c973d079-0040-49cb-937f-b7e245df7cd9-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.690198 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.690179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.690278 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.690258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.690318 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.690277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c973d079-0040-49cb-937f-b7e245df7cd9-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.699543 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.699504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c973d079-0040-49cb-937f-b7e245df7cd9-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.699903 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.699881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftkdc\" (UniqueName: \"kubernetes.io/projected/c973d079-0040-49cb-937f-b7e245df7cd9-kube-api-access-ftkdc\") pod \"istiod-openshift-gateway-5677ccb49b-87kwq\" (UID: \"c973d079-0040-49cb-937f-b7e245df7cd9\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:54.998421 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:54.998316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:55.194527 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:55.194503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"]
Jul 27 19:31:55.197209 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:31:55.197179    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc973d079_0040_49cb_937f_b7e245df7cd9.slice/crio-b013b3c831108b8e95c22480e0d51805b5c0e192c120d38973491e50ea97a5e0 WatchSource:0}: Error finding container b013b3c831108b8e95c22480e0d51805b5c0e192c120d38973491e50ea97a5e0: Status 404 returned error can't find the container with id b013b3c831108b8e95c22480e0d51805b5c0e192c120d38973491e50ea97a5e0
Jul 27 19:31:55.670612 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:55.670567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq" event={"ID":"c973d079-0040-49cb-937f-b7e245df7cd9","Type":"ContainerStarted","Data":"b013b3c831108b8e95c22480e0d51805b5c0e192c120d38973491e50ea97a5e0"}
Jul 27 19:31:57.833012 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:57.832598    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:31:57.833012 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:57.832686    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 19:31:58.689252 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:58.689220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq" event={"ID":"c973d079-0040-49cb-937f-b7e245df7cd9","Type":"ContainerStarted","Data":"dfd71a0189ddce81138478e3525fbf84ee06148b4e0a83a6b621b9edfd7a87a0"}
Jul 27 19:31:58.689461 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:58.689279    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:31:58.691198 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:58.691169    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-87kwq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 19:31:58.691316 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:58.691225    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq" podUID="c973d079-0040-49cb-937f-b7e245df7cd9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 19:31:58.723092 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:58.723033    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq" podStartSLOduration=2.090009497 podStartE2EDuration="4.723003238s" totalImagesPullingTime="2.632993741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:58.721315634 +0000 UTC m=+489.592502275" watchObservedRunningTime="2026-07-27 19:31:58.723003238 +0000 UTC m=+489.594189888"
Jul 27 19:31:59.699768 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:31:59.699732    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-87kwq"
Jul 27 19:32:01.653512 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:32:01.653476    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fdw84"
Jul 27 19:33:03.232656 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.232620    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"]
Jul 27 19:33:03.235292 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.235273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.238499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.238471    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:33:03.238499 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.238473    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:33:03.239751 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.239732    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6r6qb\""
Jul 27 19:33:03.247877 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.247856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"]
Jul 27 19:33:03.278915 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.278889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.279037 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.278921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr82j\" (UniqueName: \"kubernetes.io/projected/835ae8ee-1ef2-4edd-93bd-474c2933875b-kube-api-access-gr82j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.279037 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.278982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.379926 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.379896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.380082 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.379932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr82j\" (UniqueName: \"kubernetes.io/projected/835ae8ee-1ef2-4edd-93bd-474c2933875b-kube-api-access-gr82j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.380082 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.379985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.380296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.380278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.380344 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.380288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.394653 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.394628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr82j\" (UniqueName: \"kubernetes.io/projected/835ae8ee-1ef2-4edd-93bd-474c2933875b-kube-api-access-gr82j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.543801 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.543773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:03.676883 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.676846    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"]
Jul 27 19:33:03.678000 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:33:03.677975    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835ae8ee_1ef2_4edd_93bd_474c2933875b.slice/crio-221ec860cc36084ac1770e42ec0bda9ae0b29653c4531309c892210762cca6cb WatchSource:0}: Error finding container 221ec860cc36084ac1770e42ec0bda9ae0b29653c4531309c892210762cca6cb: Status 404 returned error can't find the container with id 221ec860cc36084ac1770e42ec0bda9ae0b29653c4531309c892210762cca6cb
Jul 27 19:33:03.827304 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.827239    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"]
Jul 27 19:33:03.830060 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.830042    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.848172 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.848149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"]
Jul 27 19:33:03.884281 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.884243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.884281 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.884288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.884461 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.884349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlt7f\" (UniqueName: \"kubernetes.io/projected/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-kube-api-access-wlt7f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.985471 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.985438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.985471 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.985472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.985682 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.985496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlt7f\" (UniqueName: \"kubernetes.io/projected/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-kube-api-access-wlt7f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.985834 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.985814    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.985900 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.985863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:03.995902 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:03.995876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlt7f\" (UniqueName: \"kubernetes.io/projected/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-kube-api-access-wlt7f\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:04.005858 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.005834    2563 generic.go:356] "Generic (PLEG): container finished" podID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerID="9a07a5e00e16906306dad76eac8ba3ad27031d8e3523c213f763f5324bc1180e" exitCode=0
Jul 27 19:33:04.005977 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.005919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz" event={"ID":"835ae8ee-1ef2-4edd-93bd-474c2933875b","Type":"ContainerDied","Data":"9a07a5e00e16906306dad76eac8ba3ad27031d8e3523c213f763f5324bc1180e"}
Jul 27 19:33:04.006025 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.006010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz" event={"ID":"835ae8ee-1ef2-4edd-93bd-474c2933875b","Type":"ContainerStarted","Data":"221ec860cc36084ac1770e42ec0bda9ae0b29653c4531309c892210762cca6cb"}
Jul 27 19:33:04.138777 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.138695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:04.267411 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.267388    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"]
Jul 27 19:33:04.268936 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:33:04.268910    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca434ca_55f4_48a6_91ca_f5ddbaba340b.slice/crio-58b5519215219f1eef3294c4e8045345f846cf687e5457ab6c010b3bac6f64f5 WatchSource:0}: Error finding container 58b5519215219f1eef3294c4e8045345f846cf687e5457ab6c010b3bac6f64f5: Status 404 returned error can't find the container with id 58b5519215219f1eef3294c4e8045345f846cf687e5457ab6c010b3bac6f64f5
Jul 27 19:33:04.375855 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.375830    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"]
Jul 27 19:33:04.378288 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.378274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.388385 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.388367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.388484 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.388397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79mj4\" (UniqueName: \"kubernetes.io/projected/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-kube-api-access-79mj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.388534 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.388514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.390519 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.390474    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"]
Jul 27 19:33:04.489296 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.489266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.489440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.489324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.489440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.489346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79mj4\" (UniqueName: \"kubernetes.io/projected/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-kube-api-access-79mj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.489735 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.489708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.489857 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.489708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.501126 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.501096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79mj4\" (UniqueName: \"kubernetes.io/projected/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-kube-api-access-79mj4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.732883 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.732860    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:04.802151 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.802120    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"]
Jul 27 19:33:04.804878 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.804861    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.822966 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.822925    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"]
Jul 27 19:33:04.881294 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.881270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"]
Jul 27 19:33:04.882692 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:33:04.882664    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35effbbf_8d55_4fad_9e08_8a170a9ccc3e.slice/crio-847e49888b4e269ebcbd76482a0edd20d14d9ca500381f39c870c42100312322 WatchSource:0}: Error finding container 847e49888b4e269ebcbd76482a0edd20d14d9ca500381f39c870c42100312322: Status 404 returned error can't find the container with id 847e49888b4e269ebcbd76482a0edd20d14d9ca500381f39c870c42100312322
Jul 27 19:33:04.892569 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.892549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvqs6\" (UniqueName: \"kubernetes.io/projected/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-kube-api-access-dvqs6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.892667 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.892584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.892726 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.892707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.993745 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.993718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.993856 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.993811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.993901 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.993854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvqs6\" (UniqueName: \"kubernetes.io/projected/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-kube-api-access-dvqs6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.994113 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.994095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:04.994238 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:04.994222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:05.011197 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.011171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvqs6\" (UniqueName: \"kubernetes.io/projected/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-kube-api-access-dvqs6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:05.012200 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.012180    2563 generic.go:356] "Generic (PLEG): container finished" podID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerID="58d0cf98ce1cd05e701d01955e7ddedfa5c21cac68331d770d7f104e00fcd36b" exitCode=0
Jul 27 19:33:05.012289 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.012257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2" event={"ID":"35effbbf-8d55-4fad-9e08-8a170a9ccc3e","Type":"ContainerDied","Data":"58d0cf98ce1cd05e701d01955e7ddedfa5c21cac68331d770d7f104e00fcd36b"}
Jul 27 19:33:05.012358 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.012302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2" event={"ID":"35effbbf-8d55-4fad-9e08-8a170a9ccc3e","Type":"ContainerStarted","Data":"847e49888b4e269ebcbd76482a0edd20d14d9ca500381f39c870c42100312322"}
Jul 27 19:33:05.013831 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.013806    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerID="ca9174aab81fbf0342057cd4682a8f74cdbf46d0694bc369276d489d1dff2ead" exitCode=0
Jul 27 19:33:05.013935 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.013888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6" event={"ID":"7ca434ca-55f4-48a6-91ca-f5ddbaba340b","Type":"ContainerDied","Data":"ca9174aab81fbf0342057cd4682a8f74cdbf46d0694bc369276d489d1dff2ead"}
Jul 27 19:33:05.013935 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.013926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6" event={"ID":"7ca434ca-55f4-48a6-91ca-f5ddbaba340b","Type":"ContainerStarted","Data":"58b5519215219f1eef3294c4e8045345f846cf687e5457ab6c010b3bac6f64f5"}
Jul 27 19:33:05.015844 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.015822    2563 generic.go:356] "Generic (PLEG): container finished" podID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerID="3959c572674232c2c00b1cdd4e47a2528f8bc3d7dc47e019e2e3760b092e08a3" exitCode=0
Jul 27 19:33:05.015930 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.015885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz" event={"ID":"835ae8ee-1ef2-4edd-93bd-474c2933875b","Type":"ContainerDied","Data":"3959c572674232c2c00b1cdd4e47a2528f8bc3d7dc47e019e2e3760b092e08a3"}
Jul 27 19:33:05.115579 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.115551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:05.261319 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:05.261297    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"]
Jul 27 19:33:05.263193 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:33:05.263162    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0de7dbb_49c8_40c4_bd0f_c11c67ddc3a0.slice/crio-817ae2c547bd0b585af271b626907a5020fa67b9f33d647799dcda836934a220 WatchSource:0}: Error finding container 817ae2c547bd0b585af271b626907a5020fa67b9f33d647799dcda836934a220: Status 404 returned error can't find the container with id 817ae2c547bd0b585af271b626907a5020fa67b9f33d647799dcda836934a220
Jul 27 19:33:06.022351 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:06.022306    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerID="ec5ff6adccfd6e843cbea688b44295d806e83c0820daf39c86f4e30a1121bd73" exitCode=0
Jul 27 19:33:06.022694 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:06.022396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt" event={"ID":"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0","Type":"ContainerDied","Data":"ec5ff6adccfd6e843cbea688b44295d806e83c0820daf39c86f4e30a1121bd73"}
Jul 27 19:33:06.022694 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:06.022453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt" event={"ID":"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0","Type":"ContainerStarted","Data":"817ae2c547bd0b585af271b626907a5020fa67b9f33d647799dcda836934a220"}
Jul 27 19:33:06.025398 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:06.025291    2563 generic.go:356] "Generic (PLEG): container finished" podID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerID="52fd2ac7c02ffd2f2f5617e268124d7b76c710f0c9dcabd744ee34ca09da87a1" exitCode=0
Jul 27 19:33:06.025398 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:06.025371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz" event={"ID":"835ae8ee-1ef2-4edd-93bd-474c2933875b","Type":"ContainerDied","Data":"52fd2ac7c02ffd2f2f5617e268124d7b76c710f0c9dcabd744ee34ca09da87a1"}
Jul 27 19:33:07.032468 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.032384    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerID="3ecb77f6592fb7a7ed66f3cbeb87d9445c8730488ee2922a5bf23b7e68c8341d" exitCode=0
Jul 27 19:33:07.032868 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.032469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6" event={"ID":"7ca434ca-55f4-48a6-91ca-f5ddbaba340b","Type":"ContainerDied","Data":"3ecb77f6592fb7a7ed66f3cbeb87d9445c8730488ee2922a5bf23b7e68c8341d"}
Jul 27 19:33:07.041038 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.040929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt" event={"ID":"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0","Type":"ContainerDied","Data":"ad0e8a9b87e1f6351ac3def306c2698237fcd94aa0c1b9f736e13f16fedb6a51"}
Jul 27 19:33:07.041130 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.040924    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerID="ad0e8a9b87e1f6351ac3def306c2698237fcd94aa0c1b9f736e13f16fedb6a51" exitCode=0
Jul 27 19:33:07.043222 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.043200    2563 generic.go:356] "Generic (PLEG): container finished" podID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerID="a907b27d92d8966fe4853e8129a0c225bc9c8b468acc52f755bc745342702f25" exitCode=0
Jul 27 19:33:07.043322 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.043277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2" event={"ID":"35effbbf-8d55-4fad-9e08-8a170a9ccc3e","Type":"ContainerDied","Data":"a907b27d92d8966fe4853e8129a0c225bc9c8b468acc52f755bc745342702f25"}
Jul 27 19:33:07.185989 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.185967    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:07.212066 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.212037    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-bundle\") pod \"835ae8ee-1ef2-4edd-93bd-474c2933875b\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") "
Jul 27 19:33:07.212256 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.212096    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr82j\" (UniqueName: \"kubernetes.io/projected/835ae8ee-1ef2-4edd-93bd-474c2933875b-kube-api-access-gr82j\") pod \"835ae8ee-1ef2-4edd-93bd-474c2933875b\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") "
Jul 27 19:33:07.212256 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.212149    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-util\") pod \"835ae8ee-1ef2-4edd-93bd-474c2933875b\" (UID: \"835ae8ee-1ef2-4edd-93bd-474c2933875b\") "
Jul 27 19:33:07.212896 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.212856    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-bundle" (OuterVolumeSpecName: "bundle") pod "835ae8ee-1ef2-4edd-93bd-474c2933875b" (UID: "835ae8ee-1ef2-4edd-93bd-474c2933875b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:07.215203 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.215176    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/835ae8ee-1ef2-4edd-93bd-474c2933875b-kube-api-access-gr82j" (OuterVolumeSpecName: "kube-api-access-gr82j") pod "835ae8ee-1ef2-4edd-93bd-474c2933875b" (UID: "835ae8ee-1ef2-4edd-93bd-474c2933875b"). InnerVolumeSpecName "kube-api-access-gr82j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:07.223249 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.221555    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-util" (OuterVolumeSpecName: "util") pod "835ae8ee-1ef2-4edd-93bd-474c2933875b" (UID: "835ae8ee-1ef2-4edd-93bd-474c2933875b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:07.313505 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.313477    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr82j\" (UniqueName: \"kubernetes.io/projected/835ae8ee-1ef2-4edd-93bd-474c2933875b-kube-api-access-gr82j\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:07.313505 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.313502    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-util\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:07.313505 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:07.313511    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/835ae8ee-1ef2-4edd-93bd-474c2933875b-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:08.050579 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.050546    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerID="fe60e66300cf6d3aa00487a0a77e62a9fe92b488ce822813148a1b7890e07219" exitCode=0
Jul 27 19:33:08.050968 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.050636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6" event={"ID":"7ca434ca-55f4-48a6-91ca-f5ddbaba340b","Type":"ContainerDied","Data":"fe60e66300cf6d3aa00487a0a77e62a9fe92b488ce822813148a1b7890e07219"}
Jul 27 19:33:08.052769 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.052750    2563 generic.go:356] "Generic (PLEG): container finished" podID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerID="89c8c78e1e36604ca01b58dd4636c3a05375f88ad7e4a0d04a2968c49d698e92" exitCode=0
Jul 27 19:33:08.052900 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.052818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt" event={"ID":"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0","Type":"ContainerDied","Data":"89c8c78e1e36604ca01b58dd4636c3a05375f88ad7e4a0d04a2968c49d698e92"}
Jul 27 19:33:08.054500 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.054484    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz"
Jul 27 19:33:08.054593 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.054516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz" event={"ID":"835ae8ee-1ef2-4edd-93bd-474c2933875b","Type":"ContainerDied","Data":"221ec860cc36084ac1770e42ec0bda9ae0b29653c4531309c892210762cca6cb"}
Jul 27 19:33:08.054593 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.054552    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="221ec860cc36084ac1770e42ec0bda9ae0b29653c4531309c892210762cca6cb"
Jul 27 19:33:08.056511 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.056483    2563 generic.go:356] "Generic (PLEG): container finished" podID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerID="36d1b580c8cacae71c78b19b55bc9e5210b1084e463f17652f65c97a314b7c7a" exitCode=0
Jul 27 19:33:08.056610 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:08.056521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2" event={"ID":"35effbbf-8d55-4fad-9e08-8a170a9ccc3e","Type":"ContainerDied","Data":"36d1b580c8cacae71c78b19b55bc9e5210b1084e463f17652f65c97a314b7c7a"}
Jul 27 19:33:09.239010 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.238983    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:33:09.258619 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.258601    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:09.261516 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.261487    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:09.331850 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.331787    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-util\") pod \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") "
Jul 27 19:33:09.331850 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.331829    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-bundle\") pod \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") "
Jul 27 19:33:09.332091 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.331886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79mj4\" (UniqueName: \"kubernetes.io/projected/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-kube-api-access-79mj4\") pod \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") "
Jul 27 19:33:09.332091 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.331901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-util\") pod \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\" (UID: \"35effbbf-8d55-4fad-9e08-8a170a9ccc3e\") "
Jul 27 19:33:09.332091 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.331918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvqs6\" (UniqueName: \"kubernetes.io/projected/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-kube-api-access-dvqs6\") pod \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") "
Jul 27 19:33:09.332091 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.331932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-util\") pod \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") "
Jul 27 19:33:09.332091 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.331974    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-bundle\") pod \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\" (UID: \"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0\") "
Jul 27 19:33:09.332430 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.332406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-bundle" (OuterVolumeSpecName: "bundle") pod "35effbbf-8d55-4fad-9e08-8a170a9ccc3e" (UID: "35effbbf-8d55-4fad-9e08-8a170a9ccc3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:09.332576 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.332558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-bundle\") pod \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") "
Jul 27 19:33:09.332688 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.332662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-bundle" (OuterVolumeSpecName: "bundle") pod "c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" (UID: "c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:09.332756 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.332676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlt7f\" (UniqueName: \"kubernetes.io/projected/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-kube-api-access-wlt7f\") pod \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\" (UID: \"7ca434ca-55f4-48a6-91ca-f5ddbaba340b\") "
Jul 27 19:33:09.333320 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.333296    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.333320 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.333319    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.333654 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.333322    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-bundle" (OuterVolumeSpecName: "bundle") pod "7ca434ca-55f4-48a6-91ca-f5ddbaba340b" (UID: "7ca434ca-55f4-48a6-91ca-f5ddbaba340b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:09.334399 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.334369    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-kube-api-access-79mj4" (OuterVolumeSpecName: "kube-api-access-79mj4") pod "35effbbf-8d55-4fad-9e08-8a170a9ccc3e" (UID: "35effbbf-8d55-4fad-9e08-8a170a9ccc3e"). InnerVolumeSpecName "kube-api-access-79mj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:09.335435 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.335406    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-kube-api-access-dvqs6" (OuterVolumeSpecName: "kube-api-access-dvqs6") pod "c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" (UID: "c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0"). InnerVolumeSpecName "kube-api-access-dvqs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:09.335619 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.335605    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-kube-api-access-wlt7f" (OuterVolumeSpecName: "kube-api-access-wlt7f") pod "7ca434ca-55f4-48a6-91ca-f5ddbaba340b" (UID: "7ca434ca-55f4-48a6-91ca-f5ddbaba340b"). InnerVolumeSpecName "kube-api-access-wlt7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:33:09.338184 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.338154    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-util" (OuterVolumeSpecName: "util") pod "35effbbf-8d55-4fad-9e08-8a170a9ccc3e" (UID: "35effbbf-8d55-4fad-9e08-8a170a9ccc3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:09.339566 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.339546    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-util" (OuterVolumeSpecName: "util") pod "7ca434ca-55f4-48a6-91ca-f5ddbaba340b" (UID: "7ca434ca-55f4-48a6-91ca-f5ddbaba340b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:09.340291 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.340274    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-util" (OuterVolumeSpecName: "util") pod "c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" (UID: "c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:33:09.434511 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.434483    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79mj4\" (UniqueName: \"kubernetes.io/projected/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-kube-api-access-79mj4\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.434511 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.434505    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35effbbf-8d55-4fad-9e08-8a170a9ccc3e-util\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.434511 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.434515    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvqs6\" (UniqueName: \"kubernetes.io/projected/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-kube-api-access-dvqs6\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.434699 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.434523    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0-util\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.434699 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.434530    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-bundle\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.434699 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.434537    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlt7f\" (UniqueName: \"kubernetes.io/projected/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-kube-api-access-wlt7f\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:09.434699 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:09.434545    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ca434ca-55f4-48a6-91ca-f5ddbaba340b-util\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 19:33:10.069459 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.069429    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt"
Jul 27 19:33:10.069459 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.069447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt" event={"ID":"c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0","Type":"ContainerDied","Data":"817ae2c547bd0b585af271b626907a5020fa67b9f33d647799dcda836934a220"}
Jul 27 19:33:10.069735 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.069496    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="817ae2c547bd0b585af271b626907a5020fa67b9f33d647799dcda836934a220"
Jul 27 19:33:10.071308 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.071286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2"
Jul 27 19:33:10.071410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.071322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2" event={"ID":"35effbbf-8d55-4fad-9e08-8a170a9ccc3e","Type":"ContainerDied","Data":"847e49888b4e269ebcbd76482a0edd20d14d9ca500381f39c870c42100312322"}
Jul 27 19:33:10.071410 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.071379    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="847e49888b4e269ebcbd76482a0edd20d14d9ca500381f39c870c42100312322"
Jul 27 19:33:10.073440 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.073420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6" event={"ID":"7ca434ca-55f4-48a6-91ca-f5ddbaba340b","Type":"ContainerDied","Data":"58b5519215219f1eef3294c4e8045345f846cf687e5457ab6c010b3bac6f64f5"}
Jul 27 19:33:10.073515 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.073451    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58b5519215219f1eef3294c4e8045345f846cf687e5457ab6c010b3bac6f64f5"
Jul 27 19:33:10.073515 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:33:10.073476    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6"
Jul 27 19:34:14.159167 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159080    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159549    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159563    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159580    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159588    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159594    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159600    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159616    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159625    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159634    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159641    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159655    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159660    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159669    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159673    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerName="util"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159679    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159686    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159697    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159704    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159728    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159733    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159739    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159744    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159750    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159756    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerName="pull"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159831    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca434ca-55f4-48a6-91ca-f5ddbaba340b" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159838    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="835ae8ee-1ef2-4edd-93bd-474c2933875b" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159846    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0" containerName="extract"
Jul 27 19:34:14.160599 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.159852    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="35effbbf-8d55-4fad-9e08-8a170a9ccc3e" containerName="extract"
Jul 27 19:34:14.161849 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.161833    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.164544 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.164527    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:34:14.164680 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.164628    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 19:34:14.164680 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.164628    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:34:14.164770 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.164755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6r6qb\""
Jul 27 19:34:14.173839 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.173817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:34:14.199558 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.199532    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:34:14.292655 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.292610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjksk\" (UniqueName: \"kubernetes.io/projected/147c42e8-0f48-4f03-a6a0-f468b5573dbb-kube-api-access-zjksk\") pod \"limitador-limitador-54d6d988d5-llxzz\" (UID: \"147c42e8-0f48-4f03-a6a0-f468b5573dbb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.292837 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.292668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/147c42e8-0f48-4f03-a6a0-f468b5573dbb-config-file\") pod \"limitador-limitador-54d6d988d5-llxzz\" (UID: \"147c42e8-0f48-4f03-a6a0-f468b5573dbb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.393166 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.393138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjksk\" (UniqueName: \"kubernetes.io/projected/147c42e8-0f48-4f03-a6a0-f468b5573dbb-kube-api-access-zjksk\") pod \"limitador-limitador-54d6d988d5-llxzz\" (UID: \"147c42e8-0f48-4f03-a6a0-f468b5573dbb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.393327 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.393179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/147c42e8-0f48-4f03-a6a0-f468b5573dbb-config-file\") pod \"limitador-limitador-54d6d988d5-llxzz\" (UID: \"147c42e8-0f48-4f03-a6a0-f468b5573dbb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.393781 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.393763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/147c42e8-0f48-4f03-a6a0-f468b5573dbb-config-file\") pod \"limitador-limitador-54d6d988d5-llxzz\" (UID: \"147c42e8-0f48-4f03-a6a0-f468b5573dbb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.404480 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.404452    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjksk\" (UniqueName: \"kubernetes.io/projected/147c42e8-0f48-4f03-a6a0-f468b5573dbb-kube-api-access-zjksk\") pod \"limitador-limitador-54d6d988d5-llxzz\" (UID: \"147c42e8-0f48-4f03-a6a0-f468b5573dbb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.472745 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.472653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:14.602432 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:14.602407    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:34:14.603674 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:34:14.603651    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147c42e8_0f48_4f03_a6a0_f468b5573dbb.slice/crio-68558e5e3b6c2e91b6e5440a5b009371c5611bd154cb484a5abd9e06a57fd24e WatchSource:0}: Error finding container 68558e5e3b6c2e91b6e5440a5b009371c5611bd154cb484a5abd9e06a57fd24e: Status 404 returned error can't find the container with id 68558e5e3b6c2e91b6e5440a5b009371c5611bd154cb484a5abd9e06a57fd24e
Jul 27 19:34:15.412672 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:15.412638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz" event={"ID":"147c42e8-0f48-4f03-a6a0-f468b5573dbb","Type":"ContainerStarted","Data":"68558e5e3b6c2e91b6e5440a5b009371c5611bd154cb484a5abd9e06a57fd24e"}
Jul 27 19:34:17.425081 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:17.424991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz" event={"ID":"147c42e8-0f48-4f03-a6a0-f468b5573dbb","Type":"ContainerStarted","Data":"edf2ffe8288e377c342a4fbd4153c690d1e688711ef45fec148048105dee1d07"}
Jul 27 19:34:17.425452 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:17.425143    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:34:17.451888 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:17.448839    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz" podStartSLOduration=0.905605329 podStartE2EDuration="3.448821125s" totalImagesPullingTime="2.543215796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:17.444859037 +0000 UTC m=+628.316045689" watchObservedRunningTime="2026-07-27 19:34:17.448821125 +0000 UTC m=+628.320007774"
Jul 27 19:34:28.431745 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:34:28.431717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-llxzz"
Jul 27 19:35:26.458041 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:35:26.458004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:35:43.647107 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:35:43.647072    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:35:54.542566 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:35:54.542530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:36:06.745962 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.745893    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86559"]
Jul 27 19:36:06.749641 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.749624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.753566 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.753546    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:36:06.753694 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.753617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 19:36:06.753854 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.753840    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l7pwx\""
Jul 27 19:36:06.765495 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.765474    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:36:06.768116 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.768096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86559"]
Jul 27 19:36:06.846572 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.846542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.846572 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.846574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.846773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.846606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.846773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.846655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.846773 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.846695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjqv7\" (UniqueName: \"kubernetes.io/projected/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-kube-api-access-wjqv7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.846906 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.846777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948136 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948269 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948269 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948269 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948269 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948422 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjqv7\" (UniqueName: \"kubernetes.io/projected/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-kube-api-access-wjqv7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948573 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948617 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.948655 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.948616    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.950565 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.950549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.950721 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.950706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:06.965028 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:06.965007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjqv7\" (UniqueName: \"kubernetes.io/projected/f39ac5ad-53d3-48e9-9fba-0bd9e2cab645-kube-api-access-wjqv7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86559\" (UID: \"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:07.059624 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:07.059591    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:07.191290 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:07.191260    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86559"]
Jul 27 19:36:07.192545 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:36:07.192521    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39ac5ad_53d3_48e9_9fba_0bd9e2cab645.slice/crio-a194eeca40256bf403d27e93236f81769befb1a1b4a4b0937a96d69754d38abd WatchSource:0}: Error finding container a194eeca40256bf403d27e93236f81769befb1a1b4a4b0937a96d69754d38abd: Status 404 returned error can't find the container with id a194eeca40256bf403d27e93236f81769befb1a1b4a4b0937a96d69754d38abd
Jul 27 19:36:07.193774 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:07.193759    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:36:07.938312 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:07.938282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:36:07.997471 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:07.997431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559" event={"ID":"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645","Type":"ContainerStarted","Data":"a194eeca40256bf403d27e93236f81769befb1a1b4a4b0937a96d69754d38abd"}
Jul 27 19:36:09.005562 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:09.005526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559" event={"ID":"f39ac5ad-53d3-48e9-9fba-0bd9e2cab645","Type":"ContainerStarted","Data":"b30e7d1e30eebb22981d4c025adfa3dfc7c775399758c28559102b2fff7cd46e"}
Jul 27 19:36:09.026606 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:09.026562    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559" podStartSLOduration=1.924621868 podStartE2EDuration="3.026547084s" totalImagesPullingTime="1.101925216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:09.024848377 +0000 UTC m=+739.896035051" watchObservedRunningTime="2026-07-27 19:36:09.026547084 +0000 UTC m=+739.897733711"
Jul 27 19:36:16.448757 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:16.448721    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:36:17.060000 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.059965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:17.060000 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.060012    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:17.072037 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.072016    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:17.560585 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.560552    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"]
Jul 27 19:36:17.565054 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.565036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.568143 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.568118    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 27 19:36:17.577785 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.577766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"]
Jul 27 19:36:17.747476 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.747442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.747476 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.747471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.747721 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.747511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.747721 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.747617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.747721 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.747661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6db46b-d775-467f-a7ed-b17deca3e61e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.747721 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.747677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbr2v\" (UniqueName: \"kubernetes.io/projected/df6db46b-d775-467f-a7ed-b17deca3e61e-kube-api-access-hbr2v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849228 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849228 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6db46b-d775-467f-a7ed-b17deca3e61e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849228 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbr2v\" (UniqueName: \"kubernetes.io/projected/df6db46b-d775-467f-a7ed-b17deca3e61e-kube-api-access-hbr2v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849522 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849522 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849522 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849670 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849670 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.849769 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.849708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.851526 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.851504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df6db46b-d775-467f-a7ed-b17deca3e61e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.851741 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.851727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6db46b-d775-467f-a7ed-b17deca3e61e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.860846 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.860826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbr2v\" (UniqueName: \"kubernetes.io/projected/df6db46b-d775-467f-a7ed-b17deca3e61e-kube-api-access-hbr2v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n5kfr\" (UID: \"df6db46b-d775-467f-a7ed-b17deca3e61e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:17.875017 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:17.874997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:18.007370 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:18.007342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"]
Jul 27 19:36:18.008463 ip-10-0-130-91 kubenswrapper[2563]: W0727 19:36:18.008439    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6db46b_d775_467f_a7ed_b17deca3e61e.slice/crio-2b54210425a5268ef2502b43d71f90b8d58f092c5aff9aadf25173324182709d WatchSource:0}: Error finding container 2b54210425a5268ef2502b43d71f90b8d58f092c5aff9aadf25173324182709d: Status 404 returned error can't find the container with id 2b54210425a5268ef2502b43d71f90b8d58f092c5aff9aadf25173324182709d
Jul 27 19:36:18.055353 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:18.055323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr" event={"ID":"df6db46b-d775-467f-a7ed-b17deca3e61e","Type":"ContainerStarted","Data":"2b54210425a5268ef2502b43d71f90b8d58f092c5aff9aadf25173324182709d"}
Jul 27 19:36:18.066605 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:18.066584    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86559"
Jul 27 19:36:19.062098 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:19.062055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr" event={"ID":"df6db46b-d775-467f-a7ed-b17deca3e61e","Type":"ContainerStarted","Data":"0240461cbb3501e04d319f60d81c1c9372035e06d32780b537d8fb0feaa6d4be"}
Jul 27 19:36:19.085319 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:19.085266    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr" podStartSLOduration=1.733535656 podStartE2EDuration="2.085251563s" totalImagesPullingTime="351.715907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:36:19.082656621 +0000 UTC m=+749.953843270" watchObservedRunningTime="2026-07-27 19:36:19.085251563 +0000 UTC m=+749.956438211"
Jul 27 19:36:26.253074 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:26.253042    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:36:27.875287 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:27.875256    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:27.875626 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:27.875310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:27.887578 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:27.887547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:28.119262 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:28.119236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n5kfr"
Jul 27 19:36:31.651776 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:36:31.651733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:38:28.254457 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:38:28.254419    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:38:38.752335 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:38:38.752299    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:38:49.456303 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:38:49.456274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:40:31.145818 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:40:31.145782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:41:10.769249 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:41:10.769219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:41:18.554796 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:41:18.554763    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:41:29.148235 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:41:29.148195    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:41:37.845787 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:41:37.845751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:41:48.852990 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:41:48.852936    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:41:58.651967 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:41:58.651912    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:42:09.453103 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:42:09.453068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:42:19.154711 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:42:19.154668    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:42:41.245988 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:42:41.245927    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:42:51.342170 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:42:51.342125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:43:14.848013 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:43:14.847916    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:43:27.057899 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:43:27.057855    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:43:43.562101 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:43:43.562066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:43:53.360924 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:43:53.360888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:44:08.159199 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:44:08.159162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:46:08.550165 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:46:08.550127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:46:18.055536 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:46:18.055434    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:46:31.064248 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:46:31.064215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:46:41.174684 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:46:41.174650    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:46:52.763329 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:46:52.763292    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:47:03.553547 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:47:03.553508    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:47:11.567733 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:47:11.567693    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:47:22.772847 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:47:22.772810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:47:34.447625 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:47:34.447587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:47:43.062579 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:47:43.062541    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:47:53.954139 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:47:53.954103    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:48:18.339799 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:48:18.339766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:48:25.755122 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:48:25.755084    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:48:43.246474 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:48:43.246438    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:48:59.151485 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:48:59.151447    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:49:12.556260 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:49:12.556183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:49:26.043471 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:49:26.043433    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:49:36.158309 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:49:36.158273    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:49:48.149433 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:49:48.149400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:50:02.460099 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:50:02.460062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:50:11.461313 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:50:11.461277    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:50:25.251779 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:50:25.251741    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:50:34.741096 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:50:34.741058    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:50:47.964830 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:50:47.964795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:50:57.162159 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:50:57.162123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:51:06.754730 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:51:06.754694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:51:16.645662 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:51:16.645621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:51:30.063694 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:51:30.063657    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:51:38.547644 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:51:38.547611    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:51:51.358311 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:51:51.358278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:52:03.362164 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:52:03.362133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:52:15.870332 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:52:15.870258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:52:26.855220 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:52:26.855183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:52:39.843831 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:52:39.843795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:52:48.743853 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:52:48.743815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:53:04.153161 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:53:04.153122    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:58:18.446258 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:58:18.446224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 19:58:28.863803 ip-10-0-130-91 kubenswrapper[2563]: I0727 19:58:28.863768    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:01:46.141279 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:01:46.141240    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:01:56.543617 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:01:56.543582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:07:11.040811 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:07:11.040717    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:07:22.351963 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:07:22.351919    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:12:35.341329 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:12:35.341292    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:14:06.134274 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:14:06.134233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:14:16.378892 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:14:16.378852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:14:26.949525 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:14:26.949493    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:14:39.142085 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:14:39.142049    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:14:52.642718 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:14:52.642682    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:15:32.487857 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:15:32.487822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:15:48.251009 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:15:48.250976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:16:00.643045 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:16:00.643013    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:16:18.045869 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:16:18.045788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:16:29.231770 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:16:29.231735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:17:20.656113 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:17:20.656074    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:17:31.036475 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:17:31.036435    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:18:23.641541 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:18:23.641507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:18:36.844557 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:18:36.844517    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:18:45.544414 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:18:45.544373    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:19:11.536782 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:19:11.536700    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:19:56.647571 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:19:56.647526    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:20:06.346647 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:20:06.346612    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:20:26.150982 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:20:26.150933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:20:46.542885 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:20:46.542847    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:21:04.541480 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:21:04.541443    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:21:20.462924 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:21:20.462886    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:21:47.850887 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:21:47.850856    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:22:06.547473 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:22:06.547436    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:22:19.576000 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:22:19.575907    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:22:30.945398 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:22:30.945364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:22:57.747520 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:22:57.747488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:23:23.749009 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:23:23.748973    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:23:51.138239 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:23:51.138206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:24:07.037745 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:24:07.037706    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:24:35.138051 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:24:35.138009    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:24:53.243621 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:24:53.243584    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:25:16.043217 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:25:16.043131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:25:34.447106 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:25:34.447067    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:25:58.338706 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:25:58.338667    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:26:15.840157 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:26:15.840109    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:26:38.439835 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:26:38.439801    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:26:57.237821 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:26:57.237784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:27:22.548102 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:27:22.548063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:27:39.933282 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:27:39.933247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:27:53.132791 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:27:53.132749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:28:08.834737 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:28:08.834704    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:28:41.736902 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:28:41.736865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:28:59.744116 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:28:59.744080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:29:15.039489 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:29:15.039450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:29:28.058870 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:29:28.058834    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:29:39.934715 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:29:39.934616    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:29:56.038535 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:29:56.038500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:30:31.433219 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:30:31.433181    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:30:49.139624 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:30:49.139588    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:31:11.236040 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:11.235818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:31:20.054892 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.054854    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140181158048176"]
Jul 27 20:31:20.058414 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.058398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158048176"
Jul 27 20:31:20.061287 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.061261    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2wsq4\""
Jul 27 20:31:20.066672 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.066649    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158048176"]
Jul 27 20:31:20.215872 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.215839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdp62\" (UniqueName: \"kubernetes.io/projected/b8a0f78b-01c0-4310-bb48-8216e5933aa5-kube-api-access-zdp62\") pod \"test-curl-7350-140181158048176\" (UID: \"b8a0f78b-01c0-4310-bb48-8216e5933aa5\") " pod="opendatahub/test-curl-7350-140181158048176"
Jul 27 20:31:20.316763 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.316671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdp62\" (UniqueName: \"kubernetes.io/projected/b8a0f78b-01c0-4310-bb48-8216e5933aa5-kube-api-access-zdp62\") pod \"test-curl-7350-140181158048176\" (UID: \"b8a0f78b-01c0-4310-bb48-8216e5933aa5\") " pod="opendatahub/test-curl-7350-140181158048176"
Jul 27 20:31:20.326067 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.326038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdp62\" (UniqueName: \"kubernetes.io/projected/b8a0f78b-01c0-4310-bb48-8216e5933aa5-kube-api-access-zdp62\") pod \"test-curl-7350-140181158048176\" (UID: \"b8a0f78b-01c0-4310-bb48-8216e5933aa5\") " pod="opendatahub/test-curl-7350-140181158048176"
Jul 27 20:31:20.369044 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.369017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158048176"
Jul 27 20:31:20.503969 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.503913    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158048176"]
Jul 27 20:31:20.505122 ip-10-0-130-91 kubenswrapper[2563]: W0727 20:31:20.505099    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8a0f78b_01c0_4310_bb48_8216e5933aa5.slice/crio-fce8e7aa68f33eba0d35d159940582e7f6c0d514c492bb424817038d819f45a7 WatchSource:0}: Error finding container fce8e7aa68f33eba0d35d159940582e7f6c0d514c492bb424817038d819f45a7: Status 404 returned error can't find the container with id fce8e7aa68f33eba0d35d159940582e7f6c0d514c492bb424817038d819f45a7
Jul 27 20:31:20.506449 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.506433    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 20:31:20.735450 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:20.735368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158048176" event={"ID":"b8a0f78b-01c0-4310-bb48-8216e5933aa5","Type":"ContainerStarted","Data":"fce8e7aa68f33eba0d35d159940582e7f6c0d514c492bb424817038d819f45a7"}
Jul 27 20:31:21.742025 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:21.741989    2563 generic.go:356] "Generic (PLEG): container finished" podID="b8a0f78b-01c0-4310-bb48-8216e5933aa5" containerID="81b85f2bc8f4d35f2b41fae5401da03535594be22ab234015bc8f0d0492580ad" exitCode=0
Jul 27 20:31:21.742405 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:21.742083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158048176" event={"ID":"b8a0f78b-01c0-4310-bb48-8216e5933aa5","Type":"ContainerDied","Data":"81b85f2bc8f4d35f2b41fae5401da03535594be22ab234015bc8f0d0492580ad"}
Jul 27 20:31:22.881051 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:22.881028    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158048176"
Jul 27 20:31:22.916131 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:22.916098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140181158048176_b8a0f78b-01c0-4310-bb48-8216e5933aa5/test-curl-7350-140181158048176/0.log"
Jul 27 20:31:22.937527 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:22.937493    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140181158048176"]
Jul 27 20:31:22.939607 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:22.939587    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140181158048176"]
Jul 27 20:31:23.043476 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.043453    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdp62\" (UniqueName: \"kubernetes.io/projected/b8a0f78b-01c0-4310-bb48-8216e5933aa5-kube-api-access-zdp62\") pod \"b8a0f78b-01c0-4310-bb48-8216e5933aa5\" (UID: \"b8a0f78b-01c0-4310-bb48-8216e5933aa5\") "
Jul 27 20:31:23.046014 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.045988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a0f78b-01c0-4310-bb48-8216e5933aa5-kube-api-access-zdp62" (OuterVolumeSpecName: "kube-api-access-zdp62") pod "b8a0f78b-01c0-4310-bb48-8216e5933aa5" (UID: "b8a0f78b-01c0-4310-bb48-8216e5933aa5"). InnerVolumeSpecName "kube-api-access-zdp62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:23.054083 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.054061    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140181158050480"]
Jul 27 20:31:23.054455 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.054442    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a0f78b-01c0-4310-bb48-8216e5933aa5" containerName="test-curl-7350-140181158048176"
Jul 27 20:31:23.054498 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.054457    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a0f78b-01c0-4310-bb48-8216e5933aa5" containerName="test-curl-7350-140181158048176"
Jul 27 20:31:23.054539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.054530    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8a0f78b-01c0-4310-bb48-8216e5933aa5" containerName="test-curl-7350-140181158048176"
Jul 27 20:31:23.057537 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.057523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:23.063617 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.063595    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158050480"]
Jul 27 20:31:23.144527 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.144500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqfvq\" (UniqueName: \"kubernetes.io/projected/d6a7f3f2-dcdc-406f-ae87-43b6fac97a17-kube-api-access-tqfvq\") pod \"test-curl-7350-140181158050480\" (UID: \"d6a7f3f2-dcdc-406f-ae87-43b6fac97a17\") " pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:23.144689 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.144667    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdp62\" (UniqueName: \"kubernetes.io/projected/b8a0f78b-01c0-4310-bb48-8216e5933aa5-kube-api-access-zdp62\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:31:23.246075 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.246037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqfvq\" (UniqueName: \"kubernetes.io/projected/d6a7f3f2-dcdc-406f-ae87-43b6fac97a17-kube-api-access-tqfvq\") pod \"test-curl-7350-140181158050480\" (UID: \"d6a7f3f2-dcdc-406f-ae87-43b6fac97a17\") " pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:23.257455 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.257415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqfvq\" (UniqueName: \"kubernetes.io/projected/d6a7f3f2-dcdc-406f-ae87-43b6fac97a17-kube-api-access-tqfvq\") pod \"test-curl-7350-140181158050480\" (UID: \"d6a7f3f2-dcdc-406f-ae87-43b6fac97a17\") " pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:23.367136 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.367057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:23.506798 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.506768    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158050480"]
Jul 27 20:31:23.508362 ip-10-0-130-91 kubenswrapper[2563]: W0727 20:31:23.508339    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6a7f3f2_dcdc_406f_ae87_43b6fac97a17.slice/crio-230acf424f9bd0800287e950fc55e93174d212a03bf27204d0e7074973848857 WatchSource:0}: Error finding container 230acf424f9bd0800287e950fc55e93174d212a03bf27204d0e7074973848857: Status 404 returned error can't find the container with id 230acf424f9bd0800287e950fc55e93174d212a03bf27204d0e7074973848857
Jul 27 20:31:23.586902 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.586862    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8a0f78b-01c0-4310-bb48-8216e5933aa5" path="/var/lib/kubelet/pods/b8a0f78b-01c0-4310-bb48-8216e5933aa5/volumes"
Jul 27 20:31:23.754836 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.754743    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158048176"
Jul 27 20:31:23.754836 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.754755    2563 scope.go:117] "RemoveContainer" containerID="81b85f2bc8f4d35f2b41fae5401da03535594be22ab234015bc8f0d0492580ad"
Jul 27 20:31:23.757067 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:23.756928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158050480" event={"ID":"d6a7f3f2-dcdc-406f-ae87-43b6fac97a17","Type":"ContainerStarted","Data":"230acf424f9bd0800287e950fc55e93174d212a03bf27204d0e7074973848857"}
Jul 27 20:31:24.764395 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:24.764365    2563 generic.go:356] "Generic (PLEG): container finished" podID="d6a7f3f2-dcdc-406f-ae87-43b6fac97a17" containerID="0b60719417b91d30fedf4efe4f67d1c8b657d154ea6fe5cff5db66b7bd559ce5" exitCode=0
Jul 27 20:31:24.764856 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:24.764449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158050480" event={"ID":"d6a7f3f2-dcdc-406f-ae87-43b6fac97a17","Type":"ContainerDied","Data":"0b60719417b91d30fedf4efe4f67d1c8b657d154ea6fe5cff5db66b7bd559ce5"}
Jul 27 20:31:25.338314 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:25.338279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:31:25.905461 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:25.905440    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:25.931223 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:25.931196    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140181158050480_d6a7f3f2-dcdc-406f-ae87-43b6fac97a17/test-curl-7350-140181158050480/0.log"
Jul 27 20:31:25.953431 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:25.953398    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140181158050480"]
Jul 27 20:31:25.960149 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:25.960127    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140181158050480"]
Jul 27 20:31:26.072639 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.072608    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqfvq\" (UniqueName: \"kubernetes.io/projected/d6a7f3f2-dcdc-406f-ae87-43b6fac97a17-kube-api-access-tqfvq\") pod \"d6a7f3f2-dcdc-406f-ae87-43b6fac97a17\" (UID: \"d6a7f3f2-dcdc-406f-ae87-43b6fac97a17\") "
Jul 27 20:31:26.074888 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.074863    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a7f3f2-dcdc-406f-ae87-43b6fac97a17-kube-api-access-tqfvq" (OuterVolumeSpecName: "kube-api-access-tqfvq") pod "d6a7f3f2-dcdc-406f-ae87-43b6fac97a17" (UID: "d6a7f3f2-dcdc-406f-ae87-43b6fac97a17"). InnerVolumeSpecName "kube-api-access-tqfvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:26.108668 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.108635    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:26.109031 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.109017    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a7f3f2-dcdc-406f-ae87-43b6fac97a17" containerName="test-curl-7350-140181158050480"
Jul 27 20:31:26.109078 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.109033    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a7f3f2-dcdc-406f-ae87-43b6fac97a17" containerName="test-curl-7350-140181158050480"
Jul 27 20:31:26.109113 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.109100    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a7f3f2-dcdc-406f-ae87-43b6fac97a17" containerName="test-curl-7350-140181158050480"
Jul 27 20:31:26.112079 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.112063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:26.118887 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.118863    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:26.173523 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.173493    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqfvq\" (UniqueName: \"kubernetes.io/projected/d6a7f3f2-dcdc-406f-ae87-43b6fac97a17-kube-api-access-tqfvq\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:31:26.274714 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.274683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbtvq\" (UniqueName: \"kubernetes.io/projected/d639dedf-7fd4-4e6d-bac8-e727badd5e04-kube-api-access-vbtvq\") pod \"test-curl-7350-140181158010928\" (UID: \"d639dedf-7fd4-4e6d-bac8-e727badd5e04\") " pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:26.375651 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.375559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbtvq\" (UniqueName: \"kubernetes.io/projected/d639dedf-7fd4-4e6d-bac8-e727badd5e04-kube-api-access-vbtvq\") pod \"test-curl-7350-140181158010928\" (UID: \"d639dedf-7fd4-4e6d-bac8-e727badd5e04\") " pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:26.387601 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.387571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbtvq\" (UniqueName: \"kubernetes.io/projected/d639dedf-7fd4-4e6d-bac8-e727badd5e04-kube-api-access-vbtvq\") pod \"test-curl-7350-140181158010928\" (UID: \"d639dedf-7fd4-4e6d-bac8-e727badd5e04\") " pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:26.422081 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.422053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:26.555434 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.555406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:26.556978 ip-10-0-130-91 kubenswrapper[2563]: W0727 20:31:26.556938    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd639dedf_7fd4_4e6d_bac8_e727badd5e04.slice/crio-b495685147f23b46b9a7eaec9187e0d902639867edebf32b5f67b28fbcffd791 WatchSource:0}: Error finding container b495685147f23b46b9a7eaec9187e0d902639867edebf32b5f67b28fbcffd791: Status 404 returned error can't find the container with id b495685147f23b46b9a7eaec9187e0d902639867edebf32b5f67b28fbcffd791
Jul 27 20:31:26.776982 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.776864    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:26.776982 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.776905    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="230acf424f9bd0800287e950fc55e93174d212a03bf27204d0e7074973848857"
Jul 27 20:31:26.778239 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:26.778211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158010928" event={"ID":"d639dedf-7fd4-4e6d-bac8-e727badd5e04","Type":"ContainerStarted","Data":"b495685147f23b46b9a7eaec9187e0d902639867edebf32b5f67b28fbcffd791"}
Jul 27 20:31:26.787396 ip-10-0-130-91 kubenswrapper[2563]: E0727 20:31:26.787368    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7350-140181158050480\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="d6a7f3f2-dcdc-406f-ae87-43b6fac97a17" pod="opendatahub/test-curl-7350-140181158050480"
Jul 27 20:31:27.587224 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:27.587188    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a7f3f2-dcdc-406f-ae87-43b6fac97a17" path="/var/lib/kubelet/pods/d6a7f3f2-dcdc-406f-ae87-43b6fac97a17/volumes"
Jul 27 20:31:27.784812 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:27.784777    2563 generic.go:356] "Generic (PLEG): container finished" podID="d639dedf-7fd4-4e6d-bac8-e727badd5e04" containerID="ecb6afd472e423a267432735b26ed62fc4587432b08bb0712183e17d51672e43" exitCode=0
Jul 27 20:31:27.785031 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:27.784870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158010928" event={"ID":"d639dedf-7fd4-4e6d-bac8-e727badd5e04","Type":"ContainerDied","Data":"ecb6afd472e423a267432735b26ed62fc4587432b08bb0712183e17d51672e43"}
Jul 27 20:31:28.929556 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:28.929532    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:28.951015 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:28.950987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140181158010928_d639dedf-7fd4-4e6d-bac8-e727badd5e04/test-curl-7350-140181158010928/0.log"
Jul 27 20:31:28.972737 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:28.972709    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:28.977073 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:28.977044    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:29.093651 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.093576    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:29.093964 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.093937    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d639dedf-7fd4-4e6d-bac8-e727badd5e04" containerName="test-curl-7350-140181158010928"
Jul 27 20:31:29.094019 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.093965    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d639dedf-7fd4-4e6d-bac8-e727badd5e04" containerName="test-curl-7350-140181158010928"
Jul 27 20:31:29.094056 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.094031    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d639dedf-7fd4-4e6d-bac8-e727badd5e04" containerName="test-curl-7350-140181158010928"
Jul 27 20:31:29.097155 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.097140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:29.100673 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.100649    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbtvq\" (UniqueName: \"kubernetes.io/projected/d639dedf-7fd4-4e6d-bac8-e727badd5e04-kube-api-access-vbtvq\") pod \"d639dedf-7fd4-4e6d-bac8-e727badd5e04\" (UID: \"d639dedf-7fd4-4e6d-bac8-e727badd5e04\") "
Jul 27 20:31:29.101602 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.101580    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:29.103032 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.102994    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d639dedf-7fd4-4e6d-bac8-e727badd5e04-kube-api-access-vbtvq" (OuterVolumeSpecName: "kube-api-access-vbtvq") pod "d639dedf-7fd4-4e6d-bac8-e727badd5e04" (UID: "d639dedf-7fd4-4e6d-bac8-e727badd5e04"). InnerVolumeSpecName "kube-api-access-vbtvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:29.201760 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.201727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tng82\" (UniqueName: \"kubernetes.io/projected/185a985e-6574-4971-aa80-fc2d020f27a3-kube-api-access-tng82\") pod \"test-curl-7350-140181158010928\" (UID: \"185a985e-6574-4971-aa80-fc2d020f27a3\") " pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:29.201925 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.201781    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbtvq\" (UniqueName: \"kubernetes.io/projected/d639dedf-7fd4-4e6d-bac8-e727badd5e04-kube-api-access-vbtvq\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:31:29.302403 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.302368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tng82\" (UniqueName: \"kubernetes.io/projected/185a985e-6574-4971-aa80-fc2d020f27a3-kube-api-access-tng82\") pod \"test-curl-7350-140181158010928\" (UID: \"185a985e-6574-4971-aa80-fc2d020f27a3\") " pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:29.311337 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.311311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tng82\" (UniqueName: \"kubernetes.io/projected/185a985e-6574-4971-aa80-fc2d020f27a3-kube-api-access-tng82\") pod \"test-curl-7350-140181158010928\" (UID: \"185a985e-6574-4971-aa80-fc2d020f27a3\") " pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:29.415558 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.415477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:29.549984 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.549961    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:29.552577 ip-10-0-130-91 kubenswrapper[2563]: W0727 20:31:29.552547    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod185a985e_6574_4971_aa80_fc2d020f27a3.slice/crio-34feb1fa62d825b2fafb803665fac57bd07f9f0156e50fd79d33565971a7c296 WatchSource:0}: Error finding container 34feb1fa62d825b2fafb803665fac57bd07f9f0156e50fd79d33565971a7c296: Status 404 returned error can't find the container with id 34feb1fa62d825b2fafb803665fac57bd07f9f0156e50fd79d33565971a7c296
Jul 27 20:31:29.588432 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.588402    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d639dedf-7fd4-4e6d-bac8-e727badd5e04" path="/var/lib/kubelet/pods/d639dedf-7fd4-4e6d-bac8-e727badd5e04/volumes"
Jul 27 20:31:29.797125 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.797085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158010928" event={"ID":"185a985e-6574-4971-aa80-fc2d020f27a3","Type":"ContainerStarted","Data":"34feb1fa62d825b2fafb803665fac57bd07f9f0156e50fd79d33565971a7c296"}
Jul 27 20:31:29.798269 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.798239    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:29.798408 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:29.798307    2563 scope.go:117] "RemoveContainer" containerID="ecb6afd472e423a267432735b26ed62fc4587432b08bb0712183e17d51672e43"
Jul 27 20:31:30.804770 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:30.804732    2563 generic.go:356] "Generic (PLEG): container finished" podID="185a985e-6574-4971-aa80-fc2d020f27a3" containerID="a910356d6adf1f6c6abc53c1e7b4d6eb6ceb1377dddfaefd5333d8cc96efa464" exitCode=0
Jul 27 20:31:30.805198 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:30.804820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7350-140181158010928" event={"ID":"185a985e-6574-4971-aa80-fc2d020f27a3","Type":"ContainerDied","Data":"a910356d6adf1f6c6abc53c1e7b4d6eb6ceb1377dddfaefd5333d8cc96efa464"}
Jul 27 20:31:31.944691 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:31.944661    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:31.967198 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:31.967170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7350-140181158010928_185a985e-6574-4971-aa80-fc2d020f27a3/test-curl-7350-140181158010928/0.log"
Jul 27 20:31:31.990477 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:31.990445    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:31.995343 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:31.995314    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7350-140181158010928"]
Jul 27 20:31:32.131814 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:32.131740    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tng82\" (UniqueName: \"kubernetes.io/projected/185a985e-6574-4971-aa80-fc2d020f27a3-kube-api-access-tng82\") pod \"185a985e-6574-4971-aa80-fc2d020f27a3\" (UID: \"185a985e-6574-4971-aa80-fc2d020f27a3\") "
Jul 27 20:31:32.133979 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:32.133927    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185a985e-6574-4971-aa80-fc2d020f27a3-kube-api-access-tng82" (OuterVolumeSpecName: "kube-api-access-tng82") pod "185a985e-6574-4971-aa80-fc2d020f27a3" (UID: "185a985e-6574-4971-aa80-fc2d020f27a3"). InnerVolumeSpecName "kube-api-access-tng82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:31:32.233188 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:32.233141    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tng82\" (UniqueName: \"kubernetes.io/projected/185a985e-6574-4971-aa80-fc2d020f27a3-kube-api-access-tng82\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:31:32.817640 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:32.817611    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:32.817640 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:32.817631    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34feb1fa62d825b2fafb803665fac57bd07f9f0156e50fd79d33565971a7c296"
Jul 27 20:31:32.827300 ip-10-0-130-91 kubenswrapper[2563]: E0727 20:31:32.827271    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7350-140181158010928\" is forbidden: User \"system:node:ip-10-0-130-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-91.ec2.internal' and this object" podUID="185a985e-6574-4971-aa80-fc2d020f27a3" pod="opendatahub/test-curl-7350-140181158010928"
Jul 27 20:31:33.586816 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:33.586782    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="185a985e-6574-4971-aa80-fc2d020f27a3" path="/var/lib/kubelet/pods/185a985e-6574-4971-aa80-fc2d020f27a3/volumes"
Jul 27 20:31:50.936318 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:50.936280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:31:57.240059 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.240022    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"]
Jul 27 20:31:57.241203 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.241174    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185a985e-6574-4971-aa80-fc2d020f27a3" containerName="test-curl-7350-140181158010928"
Jul 27 20:31:57.241203 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.241200    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="185a985e-6574-4971-aa80-fc2d020f27a3" containerName="test-curl-7350-140181158010928"
Jul 27 20:31:57.241348 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.241322    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="185a985e-6574-4971-aa80-fc2d020f27a3" containerName="test-curl-7350-140181158010928"
Jul 27 20:31:57.244691 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.244669    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.247464 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.247443    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-d68d13-openshift-default-dockercfg-wld6s\""
Jul 27 20:31:57.254980 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.254936    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"]
Jul 27 20:31:57.350344 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-socket\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-token\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-envoy\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774177a0-5a77-431b-ab17-7f2c62850a2a-istiod-ca-cert\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-credential-socket\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-certs\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-data\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scqv7\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-kube-api-access-scqv7\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.350991 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.350719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-podinfo\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451204 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774177a0-5a77-431b-ab17-7f2c62850a2a-istiod-ca-cert\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451204 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-credential-socket\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-certs\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-data\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scqv7\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-kube-api-access-scqv7\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-podinfo\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-socket\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-token\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-envoy\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451821 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-credential-socket\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451821 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-data\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451821 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451771    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-certs\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.451821 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-socket\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.452049 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.451982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774177a0-5a77-431b-ab17-7f2c62850a2a-istiod-ca-cert\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.453840 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.453820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-envoy\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.454052 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.454030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-podinfo\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.461001 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.460972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-token\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.461459 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.461430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scqv7\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-kube-api-access-scqv7\") pod \"e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") " pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.557324 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.557285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:31:57.702665 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.702638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"]
Jul 27 20:31:57.704938 ip-10-0-130-91 kubenswrapper[2563]: W0727 20:31:57.704894    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774177a0_5a77_431b_ab17_7f2c62850a2a.slice/crio-dddd4ef7116ca3b9d902cbb7a0938b969748e2dab933cd002861395bb10c09b9 WatchSource:0}: Error finding container dddd4ef7116ca3b9d902cbb7a0938b969748e2dab933cd002861395bb10c09b9: Status 404 returned error can't find the container with id dddd4ef7116ca3b9d902cbb7a0938b969748e2dab933cd002861395bb10c09b9
Jul 27 20:31:57.952506 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:31:57.952413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" event={"ID":"774177a0-5a77-431b-ab17-7f2c62850a2a","Type":"ContainerStarted","Data":"dddd4ef7116ca3b9d902cbb7a0938b969748e2dab933cd002861395bb10c09b9"}
Jul 27 20:32:00.416576 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:00.416535    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:32:00.416862 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:00.416610    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:32:00.416862 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:00.416637    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:32:00.973156 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:00.973117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" event={"ID":"774177a0-5a77-431b-ab17-7f2c62850a2a","Type":"ContainerStarted","Data":"eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d"}
Jul 27 20:32:00.995481 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:00.995434    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" podStartSLOduration=1.286425788 podStartE2EDuration="3.995419228s" totalImagesPullingTime="2.70899344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:32:00.992698811 +0000 UTC m=+4091.863885462" watchObservedRunningTime="2026-07-27 20:32:00.995419228 +0000 UTC m=+4091.866605876"
Jul 27 20:32:01.557476 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:01.557440    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:01.561876 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:01.561852    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:01.978489 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:01.978408    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:01.979392 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:01.979368    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:13.634017 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:13.633982    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:32:22.093760 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:22.093673    2563 generic.go:356] "Generic (PLEG): container finished" podID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerID="eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d" exitCode=0
Jul 27 20:32:22.094188 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:22.093754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" event={"ID":"774177a0-5a77-431b-ab17-7f2c62850a2a","Type":"ContainerDied","Data":"eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d"}
Jul 27 20:32:22.094234 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:22.094193    2563 scope.go:117] "RemoveContainer" containerID="eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d"
Jul 27 20:32:22.095432 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:22.095404    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:32:22.095497 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:22.095475    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:32:22.095589 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:22.095505    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:32:23.101538 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:23.101504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" event={"ID":"774177a0-5a77-431b-ab17-7f2c62850a2a","Type":"ContainerStarted","Data":"ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953"}
Jul 27 20:32:23.558295 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:23.558261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:23.558479 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:23.558424    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 20:32:23.558479 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:23.558464    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 20:32:24.558467 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:24.558432    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 20:32:24.558868 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:24.558492    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 20:32:25.558365 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:25.558325    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 20:32:25.558555 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:25.558397    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 20:32:26.558496 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:26.558461    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 20:32:26.558685 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:26.558520    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 20:32:27.562373 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:27.562341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:27.562780 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:27.562612    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:27.563358 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:27.563342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:32:48.639348 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:32:48.639311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:33:15.544536 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:15.544491    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:33:27.373871 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.373826    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"]
Jul 27 20:33:27.377041 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.377022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.379613 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.379592    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-561127-openshift-default-dockercfg-lbmvx\""
Jul 27 20:33:27.388318 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.388290    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"]
Jul 27 20:33:27.519107 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-data\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519291 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46r5z\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-kube-api-access-46r5z\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519291 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/364c8b71-0581-445f-84ae-2f6608363d50-istiod-ca-cert\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519370 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-certs\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519448 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-socket\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519448 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-credential-socket\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519530 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/364c8b71-0581-445f-84ae-2f6608363d50-istio-podinfo\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519616 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-istio-token\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.519656 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.519633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-envoy\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621114 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-data\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621114 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46r5z\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-kube-api-access-46r5z\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/364c8b71-0581-445f-84ae-2f6608363d50-istiod-ca-cert\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-certs\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-socket\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-credential-socket\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/364c8b71-0581-445f-84ae-2f6608363d50-istio-podinfo\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-istio-token\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-envoy\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621820 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-data\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621820 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621592    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-certs\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.621820 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-socket\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.622016 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.621866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-credential-socket\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.622299 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.622269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/364c8b71-0581-445f-84ae-2f6608363d50-istiod-ca-cert\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.623805 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.623787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-envoy\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.624132 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.624084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/364c8b71-0581-445f-84ae-2f6608363d50-istio-podinfo\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.630635 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.630602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46r5z\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-kube-api-access-46r5z\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.631195 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.631176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-istio-token\") pod \"e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") " pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.690155 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.690121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:27.840320 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.840295    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"]
Jul 27 20:33:27.842668 ip-10-0-130-91 kubenswrapper[2563]: W0727 20:33:27.842639    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364c8b71_0581_445f_84ae_2f6608363d50.slice/crio-8f8692923f8c8ae94acd46666f4d1bfaed3cbd1e26eda2a16c6bb2458f666935 WatchSource:0}: Error finding container 8f8692923f8c8ae94acd46666f4d1bfaed3cbd1e26eda2a16c6bb2458f666935: Status 404 returned error can't find the container with id 8f8692923f8c8ae94acd46666f4d1bfaed3cbd1e26eda2a16c6bb2458f666935
Jul 27 20:33:27.845017 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.844936    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:33:27.845110 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.845078    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:33:27.845204 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:27.845153    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:33:28.484395 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:28.484352    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" event={"ID":"364c8b71-0581-445f-84ae-2f6608363d50","Type":"ContainerStarted","Data":"60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24"}
Jul 27 20:33:28.484799 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:28.484411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" event={"ID":"364c8b71-0581-445f-84ae-2f6608363d50","Type":"ContainerStarted","Data":"8f8692923f8c8ae94acd46666f4d1bfaed3cbd1e26eda2a16c6bb2458f666935"}
Jul 27 20:33:28.510930 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:28.510874    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" podStartSLOduration=1.510854028 podStartE2EDuration="1.510854028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:33:28.508189685 +0000 UTC m=+4179.379376337" watchObservedRunningTime="2026-07-27 20:33:28.510854028 +0000 UTC m=+4179.382040727"
Jul 27 20:33:28.690461 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:28.690426    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:28.695747 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:28.695716    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:29.490321 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:29.490287    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:29.491441 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:29.491418    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:41.843058 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:41.843017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:33:50.607285 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:50.607250    2563 generic.go:356] "Generic (PLEG): container finished" podID="364c8b71-0581-445f-84ae-2f6608363d50" containerID="60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24" exitCode=0
Jul 27 20:33:50.607718 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:50.607327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" event={"ID":"364c8b71-0581-445f-84ae-2f6608363d50","Type":"ContainerDied","Data":"60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24"}
Jul 27 20:33:50.607762 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:50.607726    2563 scope.go:117] "RemoveContainer" containerID="60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24"
Jul 27 20:33:50.608962 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:50.608924    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:33:50.609034 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:50.609010    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:33:50.609071 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:50.609041    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 20:33:51.614398 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:51.614356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" event={"ID":"364c8b71-0581-445f-84ae-2f6608363d50","Type":"ContainerStarted","Data":"829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c"}
Jul 27 20:33:51.691014 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:51.690979    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:51.691210 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:51.691178    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 27 20:33:51.691255 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:51.691228    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 27 20:33:52.691443 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:52.691406    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 27 20:33:52.691826 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:52.691462    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 27 20:33:53.691394 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:53.691358    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 27 20:33:53.691614 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:53.691420    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 27 20:33:54.691289 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:54.691253    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 27 20:33:54.691469 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:54.691311    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 27 20:33:55.695331 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:55.695300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:55.695796 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:55.695670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:33:55.696329 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:33:55.696310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:34:07.643875 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:07.643841    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:34:13.430977 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:13.430887    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"]
Jul 27 20:34:13.431343 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:13.431124    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy" containerID="cri-o://829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c" gracePeriod=30
Jul 27 20:34:18.687658 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.687635    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:34:18.775576 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.775476    2563 generic.go:356] "Generic (PLEG): container finished" podID="364c8b71-0581-445f-84ae-2f6608363d50" containerID="829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c" exitCode=0
Jul 27 20:34:18.775576 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.775534    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"
Jul 27 20:34:18.775576 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.775563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" event={"ID":"364c8b71-0581-445f-84ae-2f6608363d50","Type":"ContainerDied","Data":"829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c"}
Jul 27 20:34:18.775866 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.775635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk" event={"ID":"364c8b71-0581-445f-84ae-2f6608363d50","Type":"ContainerDied","Data":"8f8692923f8c8ae94acd46666f4d1bfaed3cbd1e26eda2a16c6bb2458f666935"}
Jul 27 20:34:18.775866 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.775658    2563 scope.go:117] "RemoveContainer" containerID="829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c"
Jul 27 20:34:18.785439 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.785420    2563 scope.go:117] "RemoveContainer" containerID="60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24"
Jul 27 20:34:18.794079 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.794061    2563 scope.go:117] "RemoveContainer" containerID="829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c"
Jul 27 20:34:18.794333 ip-10-0-130-91 kubenswrapper[2563]: E0727 20:34:18.794316    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c\": container with ID starting with 829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c not found: ID does not exist" containerID="829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c"
Jul 27 20:34:18.794383 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.794343    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c"} err="failed to get container status \"829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c\": rpc error: code = NotFound desc = could not find container \"829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c\": container with ID starting with 829d2628993eeaf0a7c0ce001572b1caddf0c85575c7b75a8aa1bfffb19d7a4c not found: ID does not exist"
Jul 27 20:34:18.794383 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.794377    2563 scope.go:117] "RemoveContainer" containerID="60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24"
Jul 27 20:34:18.794618 ip-10-0-130-91 kubenswrapper[2563]: E0727 20:34:18.794602    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24\": container with ID starting with 60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24 not found: ID does not exist" containerID="60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24"
Jul 27 20:34:18.794690 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.794621    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24"} err="failed to get container status \"60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24\": rpc error: code = NotFound desc = could not find container \"60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24\": container with ID starting with 60c1bd17824760625426daeb5791640b26ebd642d63a0d36cc798c2787868e24 not found: ID does not exist"
Jul 27 20:34:18.827393 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-istio-token\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-data\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827444    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-envoy\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827478    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-certs\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/364c8b71-0581-445f-84ae-2f6608363d50-istiod-ca-cert\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827539 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46r5z\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-kube-api-access-46r5z\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827784 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-socket\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827784 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-credential-socket\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827784 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827775    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/364c8b71-0581-445f-84ae-2f6608363d50-istio-podinfo\") pod \"364c8b71-0581-445f-84ae-2f6608363d50\" (UID: \"364c8b71-0581-445f-84ae-2f6608363d50\") "
Jul 27 20:34:18.827924 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.827891    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:34:18.828116 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.828074    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:34:18.828490 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.828467    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-certs\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.828743 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.828495    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-credential-socket\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.828743 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.828735    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:34:18.828924 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.828899    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/364c8b71-0581-445f-84ae-2f6608363d50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:34:18.829019 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.828979    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-data" (OuterVolumeSpecName: "istio-data") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:34:18.830021 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.829998    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:34:18.830021 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.830004    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-istio-token" (OuterVolumeSpecName: "istio-token") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:34:18.830153 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.830020    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-kube-api-access-46r5z" (OuterVolumeSpecName: "kube-api-access-46r5z") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "kube-api-access-46r5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:34:18.830190 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.830148    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/364c8b71-0581-445f-84ae-2f6608363d50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "364c8b71-0581-445f-84ae-2f6608363d50" (UID: "364c8b71-0581-445f-84ae-2f6608363d50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:34:18.929039 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.929001    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/364c8b71-0581-445f-84ae-2f6608363d50-istiod-ca-cert\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.929039 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.929033    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46r5z\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-kube-api-access-46r5z\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.929039 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.929048    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-workload-socket\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.929315 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.929060    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/364c8b71-0581-445f-84ae-2f6608363d50-istio-podinfo\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.929315 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.929071    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/364c8b71-0581-445f-84ae-2f6608363d50-istio-token\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.929315 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.929082    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-data\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:18.929315 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:18.929094    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/364c8b71-0581-445f-84ae-2f6608363d50-istio-envoy\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:34:19.119406 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:19.119368    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"]
Jul 27 20:34:19.124745 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:19.124698    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-561127-openshift-default-864bcd56dd-strqk"]
Jul 27 20:34:19.587053 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:19.587024    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="364c8b71-0581-445f-84ae-2f6608363d50" path="/var/lib/kubelet/pods/364c8b71-0581-445f-84ae-2f6608363d50/volumes"
Jul 27 20:34:34.141011 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:34.140980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:34:47.338414 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:34:47.338376    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:35:55.734669 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:35:55.734629    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:36:03.394981 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:03.394932    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"]
Jul 27 20:36:03.395569 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:03.395154    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy" containerID="cri-o://ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953" gracePeriod=30
Jul 27 20:36:08.648466 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.648438    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:36:08.775546 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scqv7\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-kube-api-access-scqv7\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.775546 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775501    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-token\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.775765 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-data\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.775765 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775570    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774177a0-5a77-431b-ab17-7f2c62850a2a-istiod-ca-cert\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.775765 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775587    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-certs\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.775765 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-credential-socket\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.775765 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775680    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-socket\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.775765 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775729    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-podinfo\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.776123 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775776    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-envoy\") pod \"774177a0-5a77-431b-ab17-7f2c62850a2a\" (UID: \"774177a0-5a77-431b-ab17-7f2c62850a2a\") "
Jul 27 20:36:08.776123 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.775914    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:08.776123 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774177a0-5a77-431b-ab17-7f2c62850a2a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 20:36:08.776123 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776057    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:08.776285 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:08.776526 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776505    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-credential-socket\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.776782 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776530    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-socket\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.776782 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776543    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/774177a0-5a77-431b-ab17-7f2c62850a2a-istiod-ca-cert\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.776782 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776557    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-workload-certs\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.776987 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.776852    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-data" (OuterVolumeSpecName: "istio-data") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:08.778099 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.778072    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-kube-api-access-scqv7" (OuterVolumeSpecName: "kube-api-access-scqv7") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "kube-api-access-scqv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:08.778203 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.778122    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 20:36:08.778203 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.778133    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 20:36:08.778304 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.778218    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "774177a0-5a77-431b-ab17-7f2c62850a2a" (UID: "774177a0-5a77-431b-ab17-7f2c62850a2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 20:36:08.877351 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.877312    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-envoy\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.877351 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.877340    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scqv7\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-kube-api-access-scqv7\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.877351 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.877350    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-token\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.877351 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.877358    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-data\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:08.877351 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:08.877367    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/774177a0-5a77-431b-ab17-7f2c62850a2a-istio-podinfo\") on node \"ip-10-0-130-91.ec2.internal\" DevicePath \"\""
Jul 27 20:36:09.374645 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.374614    2563 generic.go:356] "Generic (PLEG): container finished" podID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerID="ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953" exitCode=0
Jul 27 20:36:09.374825 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.374671    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"
Jul 27 20:36:09.374825 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.374697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" event={"ID":"774177a0-5a77-431b-ab17-7f2c62850a2a","Type":"ContainerDied","Data":"ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953"}
Jul 27 20:36:09.374825 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.374750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx" event={"ID":"774177a0-5a77-431b-ab17-7f2c62850a2a","Type":"ContainerDied","Data":"dddd4ef7116ca3b9d902cbb7a0938b969748e2dab933cd002861395bb10c09b9"}
Jul 27 20:36:09.374825 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.374773    2563 scope.go:117] "RemoveContainer" containerID="ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953"
Jul 27 20:36:09.384918 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.384871    2563 scope.go:117] "RemoveContainer" containerID="eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d"
Jul 27 20:36:09.394199 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.394176    2563 scope.go:117] "RemoveContainer" containerID="ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953"
Jul 27 20:36:09.394517 ip-10-0-130-91 kubenswrapper[2563]: E0727 20:36:09.394500    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953\": container with ID starting with ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953 not found: ID does not exist" containerID="ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953"
Jul 27 20:36:09.394567 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.394528    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953"} err="failed to get container status \"ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953\": rpc error: code = NotFound desc = could not find container \"ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953\": container with ID starting with ffcc154880c2d672f12c02cce2c99a7a9f71c81b13f42bad2833557e47098953 not found: ID does not exist"
Jul 27 20:36:09.394567 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.394546    2563 scope.go:117] "RemoveContainer" containerID="eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d"
Jul 27 20:36:09.394829 ip-10-0-130-91 kubenswrapper[2563]: E0727 20:36:09.394811    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d\": container with ID starting with eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d not found: ID does not exist" containerID="eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d"
Jul 27 20:36:09.394869 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.394836    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d"} err="failed to get container status \"eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d\": rpc error: code = NotFound desc = could not find container \"eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d\": container with ID starting with eac1b5b92073a9d6113a2145a832df64054a586a14742875a09ac295c86b1a4d not found: ID does not exist"
Jul 27 20:36:09.398614 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.398594    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"]
Jul 27 20:36:09.403540 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.403520    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-d68d13-openshift-default-8694b94b84-sd4lx"]
Jul 27 20:36:09.588273 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:09.588243    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" path="/var/lib/kubelet/pods/774177a0-5a77-431b-ab17-7f2c62850a2a/volumes"
Jul 27 20:36:17.737794 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:17.737759    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:36:41.033801 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:41.033763    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-llxzz"]
Jul 27 20:36:55.631767 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:55.631738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fdw84_331276c3-c4be-40d2-a738-686fcbf900ec/server/0.log"
Jul 27 20:36:56.083746 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:56.083719    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-tnjpm_3152e050-5e5b-4a85-a15b-b4fa3eb53e6a/copy-manifests/0.log"
Jul 27 20:36:56.102644 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:56.102606    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-tnjpm_3152e050-5e5b-4a85-a15b-b4fa3eb53e6a/manager/0.log"
Jul 27 20:36:57.618420 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.618391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2_35effbbf-8d55-4fad-9e08-8a170a9ccc3e/util/0.log"
Jul 27 20:36:57.624499 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.624478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2_35effbbf-8d55-4fad-9e08-8a170a9ccc3e/pull/0.log"
Jul 27 20:36:57.630558 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.630541    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2_35effbbf-8d55-4fad-9e08-8a170a9ccc3e/extract/0.log"
Jul 27 20:36:57.738108 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.738077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz_835ae8ee-1ef2-4edd-93bd-474c2933875b/extract/0.log"
Jul 27 20:36:57.744973 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.744935    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz_835ae8ee-1ef2-4edd-93bd-474c2933875b/util/0.log"
Jul 27 20:36:57.751721 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.751693    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz_835ae8ee-1ef2-4edd-93bd-474c2933875b/pull/0.log"
Jul 27 20:36:57.864425 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.864398    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt_c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0/util/0.log"
Jul 27 20:36:57.871150 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.871060    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt_c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0/pull/0.log"
Jul 27 20:36:57.877700 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.877666    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt_c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0/extract/0.log"
Jul 27 20:36:57.986467 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.986422    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6_7ca434ca-55f4-48a6-91ca-f5ddbaba340b/extract/0.log"
Jul 27 20:36:57.992835 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:57.992808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6_7ca434ca-55f4-48a6-91ca-f5ddbaba340b/util/0.log"
Jul 27 20:36:58.001709 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:58.001674    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6_7ca434ca-55f4-48a6-91ca-f5ddbaba340b/pull/0.log"
Jul 27 20:36:58.766906 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:58.766879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-llxzz_147c42e8-0f48-4f03-a6a0-f468b5573dbb/limitador/0.log"
Jul 27 20:36:59.328646 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:36:59.328612    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-87kwq_c973d079-0040-49cb-937f-b7e245df7cd9/discovery/0.log"
Jul 27 20:37:00.529514 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:00.529481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-86559_f39ac5ad-53d3-48e9-9fba-0bd9e2cab645/main/0.log"
Jul 27 20:37:00.749746 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:00.749718    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-n5kfr_df6db46b-d775-467f-a7ed-b17deca3e61e/main/0.log"
Jul 27 20:37:08.654349 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:08.654312    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x2zdf_ad80edfd-2450-4d26-b7a9-2f64b967c9e8/global-pull-secret-syncer/0.log"
Jul 27 20:37:08.826294 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:08.826264    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-srls9_c65c60fd-5d24-4135-9049-bf1d8368170a/konnectivity-agent/0.log"
Jul 27 20:37:08.850404 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:08.850373    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-91.ec2.internal_fc004288917b78b709be42f999375de6/haproxy/0.log"
Jul 27 20:37:13.255052 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.254969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2_35effbbf-8d55-4fad-9e08-8a170a9ccc3e/extract/0.log"
Jul 27 20:37:13.276652 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.276626    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2_35effbbf-8d55-4fad-9e08-8a170a9ccc3e/util/0.log"
Jul 27 20:37:13.302800 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.302765    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598nnj2_35effbbf-8d55-4fad-9e08-8a170a9ccc3e/pull/0.log"
Jul 27 20:37:13.332243 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.332216    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz_835ae8ee-1ef2-4edd-93bd-474c2933875b/extract/0.log"
Jul 27 20:37:13.353593 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.353566    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz_835ae8ee-1ef2-4edd-93bd-474c2933875b/util/0.log"
Jul 27 20:37:13.378923 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.378895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zdrqz_835ae8ee-1ef2-4edd-93bd-474c2933875b/pull/0.log"
Jul 27 20:37:13.410999 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.410973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt_c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0/extract/0.log"
Jul 27 20:37:13.433867 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.433839    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt_c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0/util/0.log"
Jul 27 20:37:13.455654 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.455632    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7346vvt_c0de7dbb-49c8-40c4-bd0f-c11c67ddc3a0/pull/0.log"
Jul 27 20:37:13.482498 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.482473    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6_7ca434ca-55f4-48a6-91ca-f5ddbaba340b/extract/0.log"
Jul 27 20:37:13.508623 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.508555    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6_7ca434ca-55f4-48a6-91ca-f5ddbaba340b/util/0.log"
Jul 27 20:37:13.528866 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:13.528839    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1b2qm6_7ca434ca-55f4-48a6-91ca-f5ddbaba340b/pull/0.log"
Jul 27 20:37:14.279305 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:14.279271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-llxzz_147c42e8-0f48-4f03-a6a0-f468b5573dbb/limitador/0.log"
Jul 27 20:37:15.766286 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.766261    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f6afd3b-27c1-4b60-b72d-9caff655bea9/alertmanager/0.log"
Jul 27 20:37:15.787639 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.787611    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f6afd3b-27c1-4b60-b72d-9caff655bea9/config-reloader/0.log"
Jul 27 20:37:15.812481 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.812447    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f6afd3b-27c1-4b60-b72d-9caff655bea9/kube-rbac-proxy-web/0.log"
Jul 27 20:37:15.832887 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.832851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f6afd3b-27c1-4b60-b72d-9caff655bea9/kube-rbac-proxy/0.log"
Jul 27 20:37:15.857969 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.857919    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f6afd3b-27c1-4b60-b72d-9caff655bea9/kube-rbac-proxy-metric/0.log"
Jul 27 20:37:15.885321 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.885294    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f6afd3b-27c1-4b60-b72d-9caff655bea9/prom-label-proxy/0.log"
Jul 27 20:37:15.906472 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.906435    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f6afd3b-27c1-4b60-b72d-9caff655bea9/init-config-reloader/0.log"
Jul 27 20:37:15.994698 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:15.994650    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rq54k_4d12bf82-977e-4983-b53d-d3976756286f/kube-state-metrics/0.log"
Jul 27 20:37:16.009300 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.009271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rq54k_4d12bf82-977e-4983-b53d-d3976756286f/kube-rbac-proxy-main/0.log"
Jul 27 20:37:16.028102 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.028012    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rq54k_4d12bf82-977e-4983-b53d-d3976756286f/kube-rbac-proxy-self/0.log"
Jul 27 20:37:16.053567 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.053547    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c7879ffcc-s2bgd_484fee4d-915f-4c60-aa7c-9e60883bd096/metrics-server/0.log"
Jul 27 20:37:16.086590 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.086553    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-gdpxd_54925c1b-f726-4a0a-b4e3-a222e315ac01/monitoring-plugin/0.log"
Jul 27 20:37:16.237631 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.237605    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8mbb_110d4af9-6a4a-4924-ad4b-8fe553f131c6/node-exporter/0.log"
Jul 27 20:37:16.259684 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.259657    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8mbb_110d4af9-6a4a-4924-ad4b-8fe553f131c6/kube-rbac-proxy/0.log"
Jul 27 20:37:16.283723 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.283635    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b8mbb_110d4af9-6a4a-4924-ad4b-8fe553f131c6/init-textfile/0.log"
Jul 27 20:37:16.408988 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.408932    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7729g_0ebf3b5a-d584-4ba4-a1e0-b0730569b06a/kube-rbac-proxy-main/0.log"
Jul 27 20:37:16.433940 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.433898    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7729g_0ebf3b5a-d584-4ba4-a1e0-b0730569b06a/kube-rbac-proxy-self/0.log"
Jul 27 20:37:16.454052 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.454020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-7729g_0ebf3b5a-d584-4ba4-a1e0-b0730569b06a/openshift-state-metrics/0.log"
Jul 27 20:37:16.672120 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.672089    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6q6rz_cdb3e6de-b7f1-4520-b94f-127fa6c49003/prometheus-operator/0.log"
Jul 27 20:37:16.687205 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.687170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6q6rz_cdb3e6de-b7f1-4520-b94f-127fa6c49003/kube-rbac-proxy/0.log"
Jul 27 20:37:16.712062 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.712016    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-4qvjs_9fd66395-7ab1-4620-b80c-94e506e1e78a/prometheus-operator-admission-webhook/0.log"
Jul 27 20:37:16.741515 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.741485    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d494d5f68-8rsp2_d55c4f78-8664-4da0-8484-6bd79393e0e0/telemeter-client/0.log"
Jul 27 20:37:16.762508 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.762483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d494d5f68-8rsp2_d55c4f78-8664-4da0-8484-6bd79393e0e0/reload/0.log"
Jul 27 20:37:16.781605 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:16.781580    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d494d5f68-8rsp2_d55c4f78-8664-4da0-8484-6bd79393e0e0/kube-rbac-proxy/0.log"
Jul 27 20:37:18.263239 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.263214    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-dndtm_cf4d9e1a-4b71-4e48-922a-641b6db539b0/networking-console-plugin/0.log"
Jul 27 20:37:18.915794 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.915753    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"]
Jul 27 20:37:18.916246 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916229    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy"
Jul 27 20:37:18.916320 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916247    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy"
Jul 27 20:37:18.916320 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916257    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy"
Jul 27 20:37:18.916320 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916262    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy"
Jul 27 20:37:18.916320 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916269    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy"
Jul 27 20:37:18.916320 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916275    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy"
Jul 27 20:37:18.916499 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916333    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy"
Jul 27 20:37:18.916499 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916340    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="364c8b71-0581-445f-84ae-2f6608363d50" containerName="istio-proxy"
Jul 27 20:37:18.916499 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916350    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy"
Jul 27 20:37:18.916499 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.916356    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="774177a0-5a77-431b-ab17-7f2c62850a2a" containerName="istio-proxy"
Jul 27 20:37:18.919658 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.919641    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:18.922418 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.922391    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vsps\"/\"openshift-service-ca.crt\""
Jul 27 20:37:18.923623 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.923606    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9vsps\"/\"default-dockercfg-gfl9g\""
Jul 27 20:37:18.923731 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.923632    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vsps\"/\"kube-root-ca.crt\""
Jul 27 20:37:18.930599 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:18.930576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"]
Jul 27 20:37:19.033764 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.033724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-sys\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.033764 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.033764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-podres\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.034019 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.033801    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9qbp\" (UniqueName: \"kubernetes.io/projected/610a06c4-2b92-47ba-b735-ef706a5284a2-kube-api-access-w9qbp\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.034019 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.033843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-lib-modules\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.034019 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.033917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-proc\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135343 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-sys\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135343 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-podres\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135599 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9qbp\" (UniqueName: \"kubernetes.io/projected/610a06c4-2b92-47ba-b735-ef706a5284a2-kube-api-access-w9qbp\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135599 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-sys\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135599 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-lib-modules\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135599 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-proc\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135599 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-podres\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135599 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-proc\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.135986 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.135930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/610a06c4-2b92-47ba-b735-ef706a5284a2-lib-modules\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.145458 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.145426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9qbp\" (UniqueName: \"kubernetes.io/projected/610a06c4-2b92-47ba-b735-ef706a5284a2-kube-api-access-w9qbp\") pod \"perf-node-gather-daemonset-qzcdt\" (UID: \"610a06c4-2b92-47ba-b735-ef706a5284a2\") " pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.231320 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.231228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.367790 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.367763    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"]
Jul 27 20:37:19.369563 ip-10-0-130-91 kubenswrapper[2563]: W0727 20:37:19.369540    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod610a06c4_2b92_47ba_b735_ef706a5284a2.slice/crio-d3cc57f607a608a4157ae1aac53272fc7ee6e5e4a0f49ce8d557611d358bef2b WatchSource:0}: Error finding container d3cc57f607a608a4157ae1aac53272fc7ee6e5e4a0f49ce8d557611d358bef2b: Status 404 returned error can't find the container with id d3cc57f607a608a4157ae1aac53272fc7ee6e5e4a0f49ce8d557611d358bef2b
Jul 27 20:37:19.769894 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.769847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt" event={"ID":"610a06c4-2b92-47ba-b735-ef706a5284a2","Type":"ContainerStarted","Data":"c1235cc41f1194ca10a8fb20244503f7016ebafbcf380bd9751d7296594cadc6"}
Jul 27 20:37:19.770087 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.769909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt" event={"ID":"610a06c4-2b92-47ba-b735-ef706a5284a2","Type":"ContainerStarted","Data":"d3cc57f607a608a4157ae1aac53272fc7ee6e5e4a0f49ce8d557611d358bef2b"}
Jul 27 20:37:19.770087 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.769936    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:19.787987 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:19.787907    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt" podStartSLOduration=1.787889056 podStartE2EDuration="1.787889056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:37:19.786749535 +0000 UTC m=+4410.657936185" watchObservedRunningTime="2026-07-27 20:37:19.787889056 +0000 UTC m=+4410.659075706"
Jul 27 20:37:21.468875 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:21.468836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2r4v_6064e7eb-a738-4115-8229-c66c32af6baf/dns/0.log"
Jul 27 20:37:21.489500 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:21.489465    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2r4v_6064e7eb-a738-4115-8229-c66c32af6baf/kube-rbac-proxy/0.log"
Jul 27 20:37:21.513144 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:21.513112    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vkzq_44654a09-d2f9-40d1-a976-c6364d2421c3/dns-node-resolver/0.log"
Jul 27 20:37:22.176851 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:22.176817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qlfvd_e4d328d4-903c-4c73-8afa-f3281045dcc1/node-ca/0.log"
Jul 27 20:37:23.439755 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:23.439723    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-87kwq_c973d079-0040-49cb-937f-b7e245df7cd9/discovery/0.log"
Jul 27 20:37:24.559596 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:24.559563    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w96pm_cf627c7a-9c73-465b-a60c-8393fdeddab5/serve-healthcheck-canary/0.log"
Jul 27 20:37:25.082596 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:25.082559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-xnbmk_9b00a821-342c-461d-9c28-202f8ff3bf0e/insights-operator/0.log"
Jul 27 20:37:25.086707 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:25.086674    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-xnbmk_9b00a821-342c-461d-9c28-202f8ff3bf0e/insights-operator/1.log"
Jul 27 20:37:25.109379 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:25.109351    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9w9xz_83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e/kube-rbac-proxy/0.log"
Jul 27 20:37:25.129405 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:25.129368    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9w9xz_83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e/exporter/0.log"
Jul 27 20:37:25.149908 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:25.149878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9w9xz_83ef8d14-3a52-4ea7-a73a-a5fafdb0ac7e/extractor/0.log"
Jul 27 20:37:25.786756 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:25.786728    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9vsps/perf-node-gather-daemonset-qzcdt"
Jul 27 20:37:28.004307 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:28.004282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fdw84_331276c3-c4be-40d2-a738-686fcbf900ec/server/0.log"
Jul 27 20:37:28.331743 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:28.331712    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-tnjpm_3152e050-5e5b-4a85-a15b-b4fa3eb53e6a/manager/0.log"
Jul 27 20:37:28.348326 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:28.348298    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c5c9bc998-tnjpm_3152e050-5e5b-4a85-a15b-b4fa3eb53e6a/copy-manifests/0.log"
Jul 27 20:37:29.667308 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:29.667272    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-776dc7b77-scdmd_3d8cc61d-3857-4f55-b9aa-f49cbe9dabd7/manager/0.log"
Jul 27 20:37:29.842827 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:29.842796    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-87kwq_c973d079-0040-49cb-937f-b7e245df7cd9/discovery/0.log"
Jul 27 20:37:31.577566 ip-10-0-130-91 kubenswrapper[2563]: I0727 20:37:31.577531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-87kwq_c973d079-0040-49cb-937f-b7e245df7cd9/discovery/0.log"